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1. Project Accomplishments 

The Columbia- Willamette Skill Builders Consortium was formed in early 1988 in 
response to a growing awareness^of the need for improved workplace literacy 
training and coordinated service 'delivery in Northwest Oregon. In June of 1990 the 
Consortium received an 18-month grant from the National Workplace Literacy 
Program to develop and demonstrate such training. 

The Consortium's eight workplace literacy training delivery partnerships were 
formed by three local community colleges working with eight businesses and 
industry associations, six labor organizations, a state-level office of community 
'college services, and a private nonprofit educational research and consulting firm. 

The Consortium's application for funding included the following objectives: 

0 Build workplace literacy partnerships among business, educators, 
labor, government, and community groups 

0 Create training that links basic skills instruction directly to the literacy 
requirements of actual jobs targeted for specialized Adult Basic 
Education (ABE) traimng programjs 

0 Address the increasing basic skill requirements of the changing 
workplace 

o Target workers with inadequate skills for continued employment, 
increased productivity or career advancement 

o Licrease productivity by improving literacy skills 

o Reduce barriers to participation in literacy training by offering 
support services appropriate to the needs of learners 

o Establish individualized, personally meaningful educational plans for 
participating learners whenever appropriate to encourage their 
continued learning 

0 Provide rigorous learner assessment and careful evaluation of the 
service delivery and Consortium Partnership model 

0 Demonstrate a replicable model for the establishment of workplace 
literacy consortia that effectively share resources and expertise in the 
development and provision of training and in the dissemination of 
assessment tools and curricula 



In this performance report we shall describe the actual accomplishments of the 
Consortium partners as they relate to these original objectives. 

Build workplace literacy partnerships . The development of these partnerships had 
begun prior to the receipt of the federal grant. After two adjustments in 
partnerships (due to lag time between grant appli' ation-and receipt of the award 
and changes in company priorities and production schedules), the following 
organizations participated in developing and delivering customized basic skills 
training: 

Anodizing, Inc. 

Associated General Contractors of America, Inc., Oregon-Columbia 

Chapter 
Clackamas Community College 

International Brotherhood of Teamsters, Chauffeurs, Warehousemen 

& Helpers of America, Union Locals No. 162 and NO. 206 
Joint Council of Teamsters No. 37 
Leupold & Stevens, Inc. 
LWO Corporation 
Mt. Hood Community College 
Nabisco, Inc. 

Northwest Oregon Labor Council, AFL-CIO 
Northwest Regional Educational Laboratory 
Oregon Cutting Systems 
Oregon Office of Community College Sei"vices 
Oregon Trucking Associations, Inc. 

Oregon- Washington Carpenters/Employers Apprenticeship and 
Training Trust 

United Brotherhood of Carpenters & Joiners of America, Local 

Union No. 247 
Warn Industries, Inc. 

As this list indicates, the Consortium pulled together a mix of Northwest businesses 
and industries, labor organizations, trade associations, and educational service and 
technical assistance providers. Upon receipt of the grant, the Consortium held a 
reception to initiate the process of collaboration and networking among partners. 
As the Skill Builders project progressed, communication within the consortium 
became focused on the design and delivery of services. The education partners - 
Clackamas Community College, Mt. Hood Community College, Portland 
Community College and the Northwest Regional Educational Laboratory 
(NWREL) ~ communicated regularly with each other via phone, FAX, and monthly 
meetings. The community college staff in turn coimnunicated directly with their 
respective business/labor partners (see the following chart, "Summary of 
Partnerships and Classes Provided"). As will be described further below, the 
Consortium also produced a series of bimonthly newsletters which provided the 
larger workplace training community (the mailing list numbered over 1,000) with 
information about the activities of the Consortium as well as a focus for discussion 
of key issues in the rapidly developing field of basic skills training for the workplace. 

Create customized basic skills instruction . Consortium staff received training in the 
design of basic skills instruction which is based on specific work-related contexts. 
This included training regarding the functional context approach and literacy task 
analysis techniques from Jorie Philippi, of Performance Plus Learning Consultants, 
Inc., the project's outside evaluator. The project's various community college staff 



Columbia- Willamette Skill Builders Consortium 
Summary of Partnerships and Classes Provided 



Partngrships aadJGlassss. 



Clackamas Community 
College: 

Oregon Cutting Systems: 

Basic Math 



Basic Writing 



Computer Basics 



Targeted Learning Center 



Warn Industries: 
Shop Math 



Computer Basics 



Teacher 



Dates 



Romano/ 
Copeland 



McKiUop 



Copeland 



Humphreys 



Copeland 



Copeland 



2/91-5/91 



Spring '91 



Summer '91 



Fall '91 



1991 



1/91--5/91 



6/91-8/91 



3/91-5/91 
Summer '91 
Fall '91 



Hours 



Students 



MW 1 1/2 hrs. 
ea. & 2x/day 

Then became a 
study group 



T 1 1/2 hrs. 



3 consecutive 
Saturdays; 
offered 3x/day, 
3 hrs. ea. Eve. 
class offered 3x 



Drop In 



T Th 2 hrs. ea. 



TTh Ihr.ea. 



1 hr. 2x/week 



N=4 



N=5 



N=27 

20 completed 
9 hrs. course 
N=27 
9 hrs. course 



N=14 



N=79 registered; 
post for 3 classes: 
1S-2R.27 



N=26 completed 
20 hrs. of 
instruction 



N=35 

(16 hrs. average) 
N^i34 

total re^stered 



Targeted Learning Center 



Humphreys 



1991 



Drop In 



N=5 



Panngrships and Classes Teacher Dates Uom Students 



Mt Hood Community 
College: 

Carpenter Apprenticeship 
Shop Math 


Clawson 
Taylor 
Cope land 


10/10/90 - 
02/28/92 


14 hrs/week 


N=307 leg. 
(Average 1-6 hrs/ 
student) 


Commercial Drivers License 
Test Preparation 


Clawson 

Taylor 

Copeland 


10/23/90 - 
02/28/92 


14 hrs/week 


N=92reg. 
Range 1-40 hrs/ 
student (average 
of 1 1 hrs to pass 
exam^ 


Anodizing. Inc.: 

Basic Measurement Matt 


Copeland 

Taylor 

Clawson 


6/91--8/91 
1/3-2/28/92 


1 hr/week for 10 

weeks 
Offered for two 

shifts 


N=34 reg. 
N=38 reg. 


Portland Community College 
Leupold & Stevens: 

English in the Workplace 


• 

B unveil & 
Clarke 

Esler 


10/17/90 

2/91-5/91 

5/91-6/91 
6/91-8/91 


2 1/2 hrs/week x 
8 weeks 
8 weeks 

8 weeks 
8 weeks 


N=13 

N=9 (same for 
two courses) 
N=8 
N=10 


Math 


Taylor 


2/12/91- 
04/04/91 

04/14/91- 
06/06/91 

1/92-2/92 


TTh, 2 1/2 hrs ea 
6 weeks 


N=15 reg. 

N=20 reg. 
(10 attended 
regularly) 
N=9 


LWO Corporarion: 

Enzlish in the Workolace 
—Beginner 


Campbell 


Fall '90 
Winter '91 
Spring '91 


TTh 1 1/2 hrs ea. 


N=24 reg. 



Partnerships and Classes 



.Tgqchsr 



English in the Workplace 
-Intermediate 



Nabisco: 
Math 



Individualized Skills 
Enhancement 



Schneider 



Huntley 



Smith 



Smith 



Pates 



11/27/90 
01/08/91 



2/1--5/6/91 



10/31/90" 
09/30/91 



10/31/90-- 
09/30/91 



Hours 



TTh 1 1/2 hrs ea. 
Added swing 
shift 



12 hour class 
offered 3-4 times 



W-Th 

Available 

7:30-3:30 



Students 



N=13 reg. 

Attendance 

dwindling 

N=10 

Attendance low 



N=42 
s 



N=13 

Hours ranged 
from 9-72 hrs. 
(3 for 8 mos 
(2-3 hrs/week 



o 

ERIC 



then entered the worksites of their respective partners to conduct needs assessments 
and become familiar with the nature of the jobs targeted through that process and 
the literacy skills required to do them. This was the basis for curriculum 
development. 

The Consortium developed customized curriculum materials and offered training in 
the following areas: basic math and measurement (shop math), basic writing, 
computer basics» commercial drivers license testpreparation, English in the 
workplace, and individual skills enhancement. The chart, "Summary of Partnerships 
and Classes Provided," lists the classes designed and offered at each of the eight 
Consortium worksites. Sample curriculum materials can be found in Appendix V. 

Although we had received training about the extent of effort needed to develop 
customized workplace curricula, we were not prepared for the amount of time 
required to (1) consolidate relationships with partner businesses and negotiate 
course content and logistics of iiistiuction delivery, and (2) develop the appropriate 
curricula. Consortium coordinators at each of the three community colleges 
established these partnerships; hov/ever, much of the continuing negotiation fell to 
the instructors because of their involvement in the worksites as they explored the 
context for training, identified workers' and employers' needs and expectations, and 
designed the curricula. 

In this area of customized curriculum design and instniction delivery, the 
Consortium suffered from lack of access tc a stable cadre of full-time instructors. 
This is a problem common to programs based at community colleges with hiring 
policies which limit the number of full-time faculty positions possible. The 
Consortium trained a number of highly skilled part-time instructors who developed 
customized curricula, taught within the Consortium, programs for awhile, and then 
found more stable, better paying jobs as trainers in local industries or state agencies. 
To a certain extent this can be viewed as a measure of the success of the 
Consortium's staff selection and training. However, the Consortium's inability to 
compete with industries and other agencies to keep its instructional staff caused 
interruptions in services and the subsequent use or staff without the initial 
specialized training. 

Address increasing basic skill requirements of t he changing workplace . Several of 
our business, industry and labor partners were chosen precisely because they were 
experiencing major changes in the ways work is organized and production 
completed. For example, Nabisco, Inc., is converting its operations from a heavy 
machine, labor-intensive process to a high-tech, streamlined production usinjg 
sophisticated computerized equipment. Employees who once were responsible for a 
single task must now be familiar with all aspects of the baking process, for example, 
as well as understand the computers being used there, troubleshoot problems, 
convert fractions to decimals and use calculators, read technical instructions (often 
written by college educated engineers), and communicate with other workers 
throughout the plant. 

Warn Industries, Inc., a manufacturer of 4-wheel drive hubs, winches, and light truck 
accessories, is also undertaking major changes in the way it does business. To 
continue to compete in the international market. Warn is streamlining its 
manufacturing process while improving quality and involving its employees. 
Conversion from specialized departments into product focus teams responsible for 
all stages of production and shipping is placing far greater demands on employees to 
use problem-solving, collaboration, and communication skills. Warn is also 



instituting a new compensation system called Pay for Knowledge. This encourages 
employees to expand their skills and become more flexible team players as well as 
experience more control over their work and salaries. 

The Consortium's partnership wit!i the Teamsters provides another example of the 
implications of changing work requixements for workers' basic skills. By April -1992, 
truck drivers across the nation must pass the new commercial drivers license exam 
mandated by the federal government. Although most agree that this tougher test 
will improve highway safety, it has caused many drivers to recognize their lack of 
basic skills, including study skills and test-taking strategies. 

In each of these partnerships, the Consortium's training has addressed the increasing 
skill requirements brought about by changes in the work envirormient. (For greater 
detail on these partnerships, see the attached copies of Skill Builders, the 
Consortium's newsletter.) 

Tar get workers 'Adth inadequate skills for c o ntinued employment, inc r eased 
pro ductivity or career advancement . All of the eight partnerships targeted workers 
with these types of skill deficits. In addition to those mentioned abovo, the shop 
math training provided for the Oregon/ Washington Carpenters/Employers 
Apprenticeship and Training Trust prepared incoming apprentices to be able to 
remain in the program and pass the required courses. At Leupold & Stevens and at 
LWO Corporation, workers could do their current jobs without improved English 
language and literacy skills, but would not be able to move up in the company or 
communicate well with fellow employee.^. Managers wanted to offer employees the 
opportunity to improve their skills so that they could be more flexible to take on 
other jobs as demands within the workplace change. Employers and workers at 
Anodizing and Oregon Cutting Systems (OCS) were concerned about increasing 
productivity (and reducing waste), as well as career advancement. In each of these 
settings. Consortium staff identified skills needed within those contexts and 
provided the appropriate training. Training in computer basics is an example of 
workers' interest in entry-level knowledge of the use of computers as preparation for 
potential changes in job requirements and job upgrades. 

Increase productivity. Despite being the "bottom line" for most businesses, as noted 
above this was not always the goal of the training requested and designed by the 
Consortium partners. It is possible that merely offermg training may result in 
improved worker morale, which can influence productivity. However, it is usually 
very difficult to identify direct cause and effect relationships between basic skills 
training and productivity. This is especially true when classes are of limited 
duration (only an hour or two per week for 4-6 v/eeks, for example). Also, the 
Consortium experienced difficulty establishing comparable and consistent data 
collection across the eight programs and three community colleges. Evaluation 
questionnaires differed from program to program and were not consistently filled 
out. 

Nevertheless, in cases where the question was considered appropriate, supervisors 
rated the effects of the training on aspects of participants' job performance (such as 
productivity, quality, quantity of work, attendance, attitude, cooperation, problem- 
solving, application of skills to job, ability to handle new procedures). The results 
were generally positive. Supervisors viewed the classes as having a useful impact on 
the participants. When asked directly about productivity, they noted slight 
improvements. Supervisor rating forms can be found in Appendix V, Instructors' 
Reports. 



Reduce barriers to participation . In planning its services the Cousortium partners 
recognized the importance of offering support services as needed by learners to 
facilitate their participation in the training. These barriers included lack of 
childcare and transportation, among others. Perhaps because the classes were 
offered at each worksite and workers' schedules were considered in planning the 
classes, these kinds of barriers were seldom voiced. Consequently, the Consortium 
did not provide childcare or transportation or other support services. The 
availability of childcare was publicized as a recruitment strategy in some programs, 
but no one requested such support. 

Establish in dividualized education plans (lEPsV An overarching goal of 
Consortium efforts has been to help workers become lifelong learners who will 
continue to upgrade their skills ana maintain their competitive, productive capacity 
as their job skills requirements change. One step toward achievmg this is 
accomplished by giving them positive educational experiences through Consortium 
classes at the worksite or in individualized tutoring offsite. Another step is to give 
them information f jid encouragement about further training and educational 
opportunities available either through their employer or at local community 
colleges. Whenever time permitted, instructors encouraged individuals to define 
and pursue their goals. In the small number of cases wherv; instruction was offered 
one-on-one (through the Targeted Learning Center at Clackamas Community 
College and through the learning lab set up at Nabisco), lEPs were developed 
together with the learner. 

Provide learner assessment and evaluation of service delivery and Consortium 
model . The Consortiuri's original proposal included an extensive plan for assessing 
learners' acquisition of i *,w slalls and knowledge and their subsequent application 
on the job, as well as a careful evaluation of the provision of services and the overall 
Consortium model. Unfortunately, in the final negotiations for funding, the funding 
agency chose to drastically reduce the assessment and evaluation component of the 
project. Consequently, learner assessment was limited to instructor-developed, 
class-specific assessments and outcome data were not consistently collectecf Pre- 
and post-test scores were compiled and are reported below in Section 3. The final 
report from the project's outside evaluator can be found in Appendix IV. 

Demonstrate a replicable model for workplace literacy consortia . The model for 
the Columbia-Willamette Skill Builders Consortium included (1) training delivery 
partnerships between education partners and business, industry and labor 
organizations; (2) technical assistance and evaluation provided by national experts 
in the field of workplace literacy training; and (3) an advisory council comprised of 
business, labor, government, community and educational agencies. The model 
encouraged collaboration among partners to make the best use of resources and 
specialized expertise in the design, development and. delivery of customized 
workDlace basic skills training and to avoid duplication of effort by colleges working 
with business or labor partners with similar needs. 

For the most part, the Consortium was successful in demonstrating this model. The 
education partners worked well together. Despite the serious s..,.iing problems 
caused by community college part-time staff requirements (noted above), the 
Consortium's developing collaboration among the three community colleges 
enabled the Skill Builders' various workplace programs to benefit from the services 
of several very skilled and dedicated part-time instructors. By sharing instructors 
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across the colleges, the Consortium was able to minimize the negative impact of the 
part-time restrictions of the individual colleges. 

Another benefit of Consortium member collaboration was the ability to share 
resources for curriculum development. As the samples c *^ curriculum materials in 
Appendix V illustrate, these instructors have become real experts in understanding 
specific work skills requirements and customizing basic skills training to fit the 
needs of individual workers and employers. 

The Consortium also enabled the community college members to develop expertise 
in certain areas and avoid duplication of effort. Collaboration through the 
Consortium allowed them to share resources, experiences and ideas about issues 
arising in the development and delivery of this ^e of training (issues regarding 
recruitment, assessment, curricula, and evaluation) and about successful strategies 
and materials. The Coordinators' and Instructors' Reports (Appendices II and V) 
go far bayond this brief overview to document the project's development and 
activities. They are a rich resource of valuable insights about the process of 
designing workplace literacy programs and implementing a consortium model of 
service delivery. 

The original proposal included a collaborative management design in which each 
education partner had a coordinator who participated in the management of the 
Consortium and the funded project. The project was to be convened by the project 
director, whose main role was designing and conducting the evaluation. With the 
federally required reduction in the evaluation component and the assignment by the 
funding agency of larger project management responsibilities to NWREL, the 
management of Consortium activities had to be renegotiated. The Consortium 
undertook this federally-funded project without having clearly redefined the roles 
and responsibilities of its education partner key staff at the Consortium 
management level. Despite goodwill and dedication to project goals on the part of 
all staff involved, this lack of clarity resurfaced during the course of Consortium 
activities. 

Ambiguity also existed regarding the degree of institutional commitment of the 
education partners. The community colleges themselves made little effort to 
institutionalize this consortium model of ser\ace delivery. In two of the three 
colleges, the institutions were undecided regarding appropriate placement of 
workplace literacy services within the colleges' departmental structure and this 
seems to have affected their willingness to extend Consortium efforts. The success 
of this project is due largely to the high level of personal commitment of the 
individual college staff (the Coordinators) involved in forming the Consortium, 
obtaining the federal grant, and carrying out the project. 

Looking back. Consortium partners agree that project results from this model could 
have been more successful if more time had been given to training coordinators and 
instructors and providing more technical assistance, particularly in the development 
and use of appropriate and consistent assessment and evaluation tools. The 
dedicated part-time instructors shouldered much of the responsibility for developing 
measures and compiling; assessment and outcome data. However, coordination 
across three community colleges with different data tracking systems and eight 
individualized workplace training programs was difficult at best. 

The third component of the model -- the advisory council - was not implemented in 
this project for reasons that are explained below. 



2. Alterations in Schedule of Accomplishments 

The original Month-by-Month Plan of Operation (Table 6 in the proposal) was 
modified during negotiations for funding. As noted above, at that time the project's 
exteirive evaluation plan was replaced by more intensive and centralized 
management, a limited outside evaluation, and the elimination of standardized 
testing and test development activities. As agreed in the grant negotiations, the 
Consortium did not conduct thi jllowing, originally proposed activities: 

Month 2: Conduct BASIS for norming purposes with sample of workers 
in targeted job classifications 

Month 3: Evaluation Team finalizes plans for conducting BASIS pre-test 
when instruction begins 

Month 4: Conduct BASIS with participating learners 



Months 5-15: Evaluation Team develops learner job performance evaluation 
methods (including collection and use of business/labor 
partners' existing productivity and performance assessment 
tools) 



Month 15: Conduct BASIS post- test 

Evaluation Team gathers learner productivity /job performance 
data 



Month 10: Evaluation Team analyzes learner outcomes data: job-specific 
program assessments; individual educational plans; BASIS pre- 
and post-test results; changes in productivity /job performance 

Month 18: Submit Project Final Report to Department of Education, to 
include: Guidelines for Evaluating Job-Specific Workplace 
Literacy Programs 

As noted above, the Consortium experienced delays in consolidating some of its 
business/labor partnerships once the project was mnded. In some cases, 
partnerships changed due to changes within companies during the time elapsed 
from submission of the proposal to receipt of funding. In other c-^es, identification 
and development of services to be delivered simply took far longer than we 
anticipated. Negotiations with company staff and labor representatives was often 
complex. Consortium instructors spent long hours on site learning about the larger 
context for the training as well as the skills required and/or desired for certain jobs. 
Curriculum developm'^nt often took far more time than instructors were 
accustomed to giving. The Plan of Operation called i:0T instruction to begin in 
Month 4. Start-up of instruction was delayed at least one month in all of the eight 
partnerships. In some instruction began as late as Month 9; two companies 
withdrew completely from the Consortium due to internal changes in priorities and 
two new companies had to be identified and their needs explored. (See the 
preceding chart, "Summary of Partnerships and Classes Provided," for dates 
mstruction was offered at each of the worksites.) 

Two activities which were not conducted by the Consortium were the formation of 
the Columbia- Willamette Workplace Literacy Advisory Council and the 
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development of a plan tor a region-wide Workplace Literacy Campaign (Months 1, 
6, 12, 18). Early in the project, nominations for membership on the Council were 
requested and some names were suggested. However, the need to dissolve some 
partnerships and form new ones and the intensity of efforts to develop targeted 
services in all partnerships delayed the formation of the Council so significantly that 
it was eventually abandoned. In retrospect, this was not a wise decision. A broadly 
representative, functioning Advisory Council could have been useful in helping 
Consortium partners clarify roles and responsibilities and lobby for needed 
institutional support. It also could have helped to increase the Consortium's 
visibility in the community and could have focused needed energy on seeking 
additional sources of funding to continue Consortium activities beyond the federal 
grant. 



3. Project Participants - Characteristics and 0\.\tcomes 

By the end of the 21 months of project activity (including a 90-day no-cost 
extension), the Consortium had provided workplace basic skills training to a total of 
987 workers, more than three times our original estimated goal. The project 
gathered data on the following demographic characteristics of participants: age, 
ethnicity, gender, education level, some information on employment status. When 
appropriate, pre- and post-test scores were also compiled. The Instructors' Reports 
(in Appendix V) present details on learner characteristics and outcomes by 
partnership and class. Summaries of participant characteristics and averages for 
pre-/post-test scores (when available) for the various partnerships follow: 

Clackamas Community College in partnership with : 

Oregon Cutting Systems . 
Computer Basics: 

Of 52 learners, 40% were men, 60% women 

4% were African American, 90% Caucasian, 6% 
Hispanic 

6% completed 11th grade, 44% completed 12th grade, 
10% had a GED, 15% had some college classes, 25% 
had more than 1 year of college (10% AA degree, 8% 
BS/BA degree) 

Age range was 19 - over i>5 

Targeted Learning Center: 

Of 15 learners, 20% were men, 80% women 

7% were African American, 7% Asian, 80% Caucasian, 
7% Hispanic 
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Of 12 reporting, 17% completed 10th grade, 50% 
completed 12th grade, 8% had a GHD, 25% had some 
college 

Age range was 19-65 
Warn Industries . 

Shop Math: 

Of 79 learners, 58% were men, 42% women 

3% were African American, 1% American Indian, 90% 
Caucasian, 4% Hispanic, 3% other 

Of 65 reporting, 11% completed less than 12th grade, 
83% completed 12th grade, 6% had a GED 

Age range was 19 - over 65 

Average increase in pre-/post-test scores was 18% for 
class of 29 learners 

Computer Basics: 

Of 134 learners, 66% were men, 34% women 

Of 133 reporting, 1% were African American, 3% 
Asian, 93% Caucasian, 3% Hispanic 

Of 134 learners, 7% completed less than 12th grade, 
56% completed 12th grade, 6% had a GED, 8% had 
some college, 23% had more than 1 year of college (7% 
AA degree, 4% BS/BA degree) 

Age range was 19 - over 65 

Average increase in pre-/post-test scores was 4% for 
class of 41 learners 



Targeted Learning Center: 

Of 5 learners, 40% were men, 60% women 

20% were Asian, 80% Caucasian 

40% completed less than 12th grade, 20% completed 
12th grade, 40% had a GED 

Mt. Hood Community College in partnership with : 

Carpenter Apprenticeship . 

Shop Math: 

Of 307 learners served, 95% were men, 5% women 



12 t 7 



Of 270 reporting, 3% were African American, 4% 
American Indian, 91% Caucasian, 2% Spanish 
Surnamed 

Of 234 reporting, 10% had less than high school, 16% 
had a GED, 71% had a high school diploma, 1% ht d 2 
years of college, 2% had 3 years of college, and 1% had 
a certificate 

Age range was 18 - 49 

Average increase in pre-/post-test scores was 134% 

Commercial Drivers License . 

Test Preparation: 

Of 92 learners, 90% were men, 10% women 

Of 8o reporting, 1%? were American Indian, 98% 
Caucasian, 1% Spanish Surnamed 

Of 64 reporting, 30% had less than high school, 10% 
had a GED, 55% had a high school diploma, and 7 % 
had 2 years of college 

Age range was 19-61 

Average increase in pre-/post-test scores was 35% 
Anodizing. Inc . 

Basic ^ leasurement Math: 

Of 72 learners, 92% were men, 8% women 

Of 24 reporting, 8% were African American, 4% Asian, 
88% Caucasian 

Of 56 reporting, 14% had less than high school, 29% 
had a GED, 38% had a high school diploma, 14%? had 2 
years of college, 4% had 3 years of college, 2% had 
Bachelor's 

Age range was 20-51 

Average increase in pre-/post-test scores was 95% for 
Summer 1991; 10% for Winter 1992 
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Portland Community College in partnership with : 

Leupold & Stevens . 

English in the Workplace: 
Fall 1990- 

Average increase in pre-/post-test scores was 1 1% (8 
learners) 

Spring and Summer 1991 -- 

Of 10 learners, 50% were men, 50% women 

40% were Asian^ 40% Hispanic, 20% other 

40% completed less than 12th grade, 40% had a high 
school diploma, 20% had BA degree 

Math: 

Winter 1991 -- 

Of I5 learners, 27% were men, 73% women 

7% were African American, 7% American Indian, 87% 
Caucasian, 7% Hispanic 

Of 14 reporting, 14% had a GED, 64% had a high 
school diploma, 21% had r me college 

Age range was 30-60 

Winter 1992 -- 

Of 9 learners, 22% were men, 78% women 

Of 6 reporting, 17% were African American, 17% 
American Indian, 50% Caucasian, 17% Hispanic 

Age range was 23-59 

Average increase in pre-/post-test scores was: 9% 
(Unit 1), -25% (Unit 2), 16% (Unit 3), 31% (Unit 4) 

LWO Corporation . 

English in the Workplace: 
Beginner, Fall and Winter 1990-91 - 
Of 21 learners, 100% were men 

14% were Asian, 86% Hispanic 

Age range was 20 -51 

Of 17 reporting, 35% made no change in performance 
level, 47% went up one level, 6% went up two levels 



14 



Intermediate, Fall and Winter 1990-91 
Of 13 learners, 100% were men 

Of 12 reporting, 33% were Asian, 67% Hispanic 

Of 8 reporting, 75% completed less than 12th grade, 
25% had some college, 100% had some previous adult 
education 

Age range was 19-39 

54% made no change in performance level, 46% went 
up one level 

Nabisco . 

Math and Individualized Skills Enhancement: 

Of 42 learners, 71% were men, 29% women 

Of 41 reporting, 83% were Caucasian, 12% African 
American, 5% Hispanic 

Of 42 reporting, 43% had less than high school, 48% 
had a high school diploma, 4% had some college 

Age range was 26 - 65 

Average increase in pre-/post-test scores in math was 
25% 

The Instructors' Reports (Appendix V) include numerous learner evaluations in 
which participants commented about their experiences and the outcomes of the 
training for them. A few examples: 

"Course was well taught -- took a lot of the mystery out of computer language 
and did encourage me to proceed in training." 

"IgotmyGED!" 

(Learner recommends the carpentry math class because it) "could help them 
solve problems for themself instead of relying on an engineer." 

"This program gave me confidence from the start with much help and 
preparation...I went on to pass the rest of the other six tests...Without this 
program and the sincere help and instruction...I wouldn't have known where 
to begin." 
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4. Dissemination Activities 



Consortium partners conducted a variety of activities to disseminate information 
about the Consortium's work and about workplace literacy training issues in general: 

0 During the first quarter of the project, a "kickoff ' event was held at a 
local hotel to present the project to the local business and labor 
community and to initiate the process of networking among 
Consortium participants. Over 60 individuals attended. 

0 Consortium partners gave a 2-hour presentation about workplace 
literacy, the Consortium and individual partnership activities at the 
Work Now and in the Future 7 Conference held November 7-8, 1990, 
in Portland, Oregon. Over 1000 educators attended the conference. 
The Consortium session was well attended and the project's work well 
received. 

0 During the third quarter, several project staff participated in 

Washington State's statewide workplace literacy conference, Building 
the Foundation. They gave a panel presentation on the Consortium 
model for delivery of workplace literacy services in contexts where 
company employees normally are ser\'ed by multiple providers. 

0 Consortium staff presented two sessions at the Work Now and in the 
Future 8 Conference in Portland November 18-19, 1991, one on 
individual company-based programs, the other on developing 
workplace literacy consortia. 

0 Staff attended the AAACE in 1991 and made a presentation about 
workplace literacy consortium service delivery. 

0 Project staff designed activities for a national telecommunications 

network among workplace Uteracy grantees. The base system for the 
network is OTAN (Outreach Technical Assistance Network), a part of 
the Connect, Inc., Information Services. 

0 Th.e project produced a bimonthly newsletter, Skill Builders, which 
debuted in January 1991. The newsletter was mailed to over 1100 
business, labor, industry, education, and community-based agencies in 
the greater Portland metropolitan area. The newsletter presented 
workplace basic skills trainmg issues and national developments while 
highlighting Consortium partnership training programs and instructors 
in each issue. Skill Builders enjoyed an enthusiastic audience locally 
and became known nationally, receiving high praise from the editor of 
the Business Council on Effective Literacy (BCEL). 



*5. Evaluation Activities 

The Consortium's Final Evaluation Report, by Jorie Philippi, of Performance Plus 
Learning Consultants, Inc., is attached to this report as Appendix IV. The fact that 
this project included eight different training programs bemg provided by three 
different community colleges made the evaluator's task very complex. Operating 
with limited resources, she has done an excellent job of pulling together a wide 
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range of data from a variety of sources. Two minor points made in the Final 
Evaluation Report need to be clarified, however: (1) At no time did the project 
director prohibit Consortium staff from communicating directly with the evaluator. 
Rather, after some confusion about timelines and channels of communication, the 
director and the evaluator agreed that coordination of data was needed and 
communication would be smoother if materials and reports were gathered by the 
director and forwarded to the evaluator rather than having individuals send them 
directly to her. (2) The evaluator distributed evaluation forms as possible forms for 
gathermg data within individual partnerships, noting that they might be adapted as 
necessary for each site. Some instructors designed their own forms. 



6. Changes in Key Personnel 

Other than the changes in part-time instructors mentioned earlier, there were no 
changes in key personnel during the course of this project. 
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Guidelines for Providing Effective Workplace Literacy Training 
Using a Consortium Model 



Appendix I. 



Guidelines for Providing Effective Workplace Literacy Training Using a 

Consortium Model 



Beyond the success of the workers served, the success of the Columbia- Willamette 
Skill Builders Consortium can be found in the lessons Consortium members learned 
about providing productive training programs and, more important, about creating 
and maintaining an effective consortium model for delivering workplace literacy 
training. 

Briefly, we have learned that workplace literacy training partnerships are more 
successful when they: 

0 Include workers from the start in the identification and clear 

definition of training needs and in the design, delivery and evaluation 
of the training itself. (This assumes the inclusion of union 
management and membership in worksites with unions.) 

0 Have clearly defined needs for training -- avoiding the ambiguous "I'm 
sure we must have a workplace literacy problem." Effective programs 
strive for agreement/common understanding of needs by 
management and workers. 

0 Identify opportunities for direct application of new skills, making sure 
that skills taught are clearly applicable to current or future jobs. 

o Compensate employees for their time spent in training. 

0 Value workplace literacy training enough to pay for at least part of it. 

0 Respect and protect workers' rights (especially confidentiality). 

0 Provide training programs at locations and times convenient for 
participants and offer support services as needed (child care, 
transportation, counseling, etc.). 

0 Are careful in selecting program and course names, avoiding the "L" 
word or words associated with remediation or basic schooling. 

In addition to ensiiring that their training programs incorporate the above 
characteristics. ef:ective workplace literacy consortia : 

0 Ensure that the education partners (training providers) share common 
goals and understandings regarding workplace literacy training and 
the role of ttie consortium. In particular, effective consortia recognize 
lifelong learning as a goal of successful companies and workers and 
work with them to foster this perspective. 

0 Identify areas of specialization among the education partners to 
reduce duplication of services. 



Create consortium positions for specialists (e.g., a curriculum 
developer) whose expertise can be shared by all consortium partners. 

Dedicate sufficient resources to curriculum development. 

Provide specialized staff training in the provision and evaluation of 
workplace literacy programs and ongoing technical assistance and 
support for staff. 

Maintain a common (shared) cadre of trained, experienced workplace 
literacy instructors, finding ways to overcome individual institutional 
constraints to provide adequate time/pay to retain them. 

Provide regular opportunities for staff discussion of 
consortium/program issues. 

Conduct shared networking and dissemination efforts to enhance the 
visibility and capabilities of the consortium. 
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Coordinators' Reports 



Coordinator Narrative 

Helen Humphreys 
Clackamas Community College 



I PROGRAM IDENITY WITHIN OUR INSTITUTION. 

The history of the Institution's interest In 9 workplace literacy grant rests with 
Dian Connett She wrote one unsuccessful Clackamas grant application In 1988 
and then helped write the successful consortium WPL grant of 1990. 

She interested three faculty members in working on the project though eventually 
one person finished it. The reasons for two of the faculty dropping the project are 
probably typical for people who already have full time assignments: intensified 
workloads, Inadequate coverage for the primary assignment, and disinterest. 
Disinterest was caused from the revelation that most of the project was going to 
Include many meetings at inconvenient times and that workplace literacy as a field 
for private consultation, post grant was also going to include much meeting and 
politicing. 




The unattractive nature of WPL as a source of private consultation Is an 
interesting and significant theme that re-occurs throughout the project One 
frustrating aspect of collaborating with some businesses Is the unpredictably large 
amounts of time ft takes for the coordinator/consultant to set up projects down 
through the management hierarchy. Another frustration is,ln some cases, the 
unwillingness of management, In some cases, to find a willing participant on their 
side to work on the project, or if they do find one, to grant him/her time and power 
to expedite the project. Much time for startup negotiations must be scheduled for, 
budgeted for, and expected. 

Clackamas's section of the Columbia/Willamete Skillbuilders Consortium 
became the responsibility of faculty member assigned to an off campus adult basic 
skills lab-Targeted Learning Center. The faculty member, Helen Humphreys, 
worked for a Alternative Programs and reported to the Dean of Student Services, 
Dian Connett. 

II PROGRAM FIT AND COLLABORATION WITH THE COLLEGE. 

Initially the assignment of the workplace literacy project to a faculty member 
at Targeted Learning Center seemed appropriate, but soon conflicts with other 
departments bubbled up. TIC had seemed a good fit because the learning lab was 



already recruiting students from among employed adults in the same geograpiiical 
area the grant proposed to cover. Another advantage of using TLC as an anchor 
for the WPL project was so we could use some of the same part-time staff and 
educational materials and resources for both projects. 

The department whose toes we stepped on was the customized contracts 
department (EMD). They reportedly felt we were providing free services, through 
the grant, that they were ready and willing to charge companies for. They were also 
concerned that we might disrupt relationships they had already established within 
the companies. 

The relationship between EMD and the WPL project eventually evolved into 
a mutually agreeable compromise. Our Dean has agreed that orice the WPL project 
is finished, EMD will tal<e over the customizing of basic sl<ills for worlcplaces. We 
have worked out a code of ethics that include the agreement that assessment 
information on individuals will not be shared with management. In other words, 
neither the workplace literacy project or EMD will assist businesses in screening 
out-firing- employees on the basis of any generic tests we might give for the 
purposes of placement in a educational program. 



ill STAFFING ISSUES. 
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I have hired about a half dozen people for short term and long term WPL 
projects. One, th. first, quit suddenly after she used up about $1,500 worth of 
resources, mostly in going to the many startup meetings. The second, Scott 
Copeland, did 90% of the curriculum development and teaching at our two 
successful projects. He did a immense Job in an outstanding manner. The other 
teachers did short term projects such as substituting, Iceyboard instruction,and a 
short English and writing series. 

The ratio of development pay to instruction pay we paid to the grant 
instructors is generous compared to the configuration for a part-time instructor on 
campus. However, the project demanded much flexing as far as class times and 
as far as customizing the curriculum went. I paid instructors 2 hours of 
development time for every hour of instruction until the courses were developed 
and revised, and then paid straight instructional pay. i budgeted for whatever time 
was necessary at the end for evaluation and data collection. 

When I compare the most successful and least successful hires, here is what 

I find: 
Similar 

* both hated committee meetings 

* both were smart 

* both were independent 



* both developed friendships with in the businesses 

* both searched for resources 

* both were looking for new careers 

* both were praised by student/employees 

* both were Interested In private consulting 

Different 

* he had experience teaching adults and she didn't 

* this was his second WPL project and her first 

* he did his own audit and she used mine 

* he worked out his own hours with the companies and she expected me to do It 

* he wanted to do the data collection and she didn't 

* he took over the reins from me and she didn't 

My conclusion about why one person was more successful as far as follow- 
through and performance, was that he felt immediate ownership based on past 
experience both with this kind of project and this kind of student. She didn't know 
where she was going so she was reluctant to take over, yet she chafed under my 
direction. 

While both hated the interminable meetings, he expected it and accepted it while 
she was disappointed and became disenchanted with this aspect of WPL 



IV LOGISTICAL CONCERNS 

Our WPL project had the ideal logistical setup. Both of our projects were 
within a mile of Targeted Learning Center, where I was located. This proximity 
enabled me to spend a minimum amount of time on the road. The proximity to TLC 
also made it easy to draw students from our projects to the privacy of our learning 
lab. We found that beginning readers were more willing learn at the lab than on 
site. Moreover, the instructors could easily use the computers or borrow materials 
and A.V. equipment from TLC. Furthermore, because the projects were less than 
two miles from each other, th^ instructors didn't have to waste time traveling from 
project site to project site. 

Both of our business partners provided adequate classroom spaces, storage 
and support services. 

Our main instructor, Scott Copeland, was able change his schedule to meet 
t ie needs of the clients. I'm well aware that not every instructor could do this. He 
taught in the evening as well as before 7am dnd on Saturdays. 



V COORDINATION AND COLLABORATION AMONG CONSORTIUM MEMBERS 



ROLES. Working out the role of Northwest Regional Education Laboratory 
within the consortium membership was the most problematic role problem we had. 
Was the lab directing the overall project or facilitating it? The unfolding of the lab's 
role was worked out at our monthly meetings. Initially a representative from each 
project reported on the progress of the project. Then the group closely questioned 
the representative. This process did not feel productive -people felt put on the 
spot and second guessed. We had a painful discussion about whether this was 
helpful or not. We decided to change the format to something that would assist the 
instructors. We switched to an inservice training format which v/orked well. From 
that point on the NWREL representatives acted as facilitators which seemed lllce a 
better fit The Lab did a great job writing the grant and distributing and excellent 
newsletter. They hosted a getting-to-l«now-you buffet for ail ♦he partners and in 
general Icept the lines of communication open. 

SHARING RESOURCES. My best Instructor was also hired by the other 
consortium members for ho»h the WPL project and other projects. I was pleased 
that he was ge Mng enough hours to afford to continue being part time. On the 
other hand that also meant his time on my projects was limited, especially the dai 
compilation and curriculum development segment(paid at half the instructional rate) 
which was put on hold. 

Sharing curriculum with Consortium members was always valuable as was 
problem solving about students. If we do this type of project again,! think this Is 



where we need to spend our shared time. Most especially we all need to have 
more curriculum resources for the kinesthetic learner which I see as being the 
dominant learning style in production worlc 

EVALUATION. The whole domain of evaluation has always been problematic 
for the consortium members. First of all, the funds for the evaluation sectlon.of our 
grant were reduced. We were torn between wanting to do an extensive evaluation 
of a new field of study and not being funded to do so. Secondly, we needed to 
create evaluation tools because WPL is a new enough field that commercial 
evaluation tools weren't adequate. And third.our business partners were 
disappointed that we weren't able to have technical help with evaluation .Evaluation 
would be where they could convince managers and shareholders of the need for 
and value of worlcplace literacy instruction. We decided to do what we v^ad time 
and money for, of course. 



VI ADVANTAGES OF THE CONSORTIUM MODEL TO BUSINESSES. 

There are potential advantages for both community colleges and businesses 
with a consortium type of organization to deliver basic sicills instruction to 
employees. If the consortium could act as a clearing house, it could screen clients 
to the colleges based on specialized instruction or proximity. The Consotium 
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clearinghouse could market for all the colleges. It could establish a standard cost 
which might be underwritten by the Department of Economic Development The 
colleges could share start up costs, staff, Inservice costs and a standard code of 
ethics. The businesses would have one convenient agency to deal with for the 
subject of WPL 

VII DISADVANTAGES OF THE CONSORTIUM MODEL 

Although the consortium model has been positive for the most part, this 
structure has disadvantages. The life of the consortium depends on the fate of 
each Individual college and even more, each individual department within the 
individual college. Departmental reorganization at one college threatened our whole 
consortium organization at one point. Some territorial problems still exist among 
colleges. The consortium's own coordination and communication issues take much 
of the individual coordinator's time. Some mechanical issues such as dispersement 
of funds from one college to another are cumbersome. 

VIII CRITICAL AREAS FOR IMPROVEMENT. 

PARTNERS. We should pick our business partners very carefully. In many 



ways those partners to whom we have to give a hard sell about the benefits of 
collaboration, are not ready to deal with workplace literacy. We should look around 
longer to find the company who has started to deal with literacy issues on their 
own: they are going to be more willing and more committed to workplace literacy 
for their own reasons. I would look for small companies who are interested in 
Demming's theories of management or in pay-for-knowledge systems as those who 
might easily fold workplace literacy into existing training structures Instead of 
considering it an add-on. 

COMMUNICATION. We must keep the communication lines open at every 
level both within the business and within the college's part of the project Business 
partners should know what Is necessary from them In the way of time and 
resources. We need to set up mileposts at which time we agree to discuss the 
critical issues as well as house keeping. One critical issue that should be discussed 
at each milepost is evaluation; how do we know we are making an Impact. Since 
evaluation issues will be different for every company, I think developing custom 
qualitative and quantitative evaluation tools, testing them and revising them would 
be the major collaborative effort other than recruitment of students and customizing 
basic skills curriculum. 

CU^RIFY AND ORGANIZE THE PROJECT The college partners need to clarify 
some in-house issues such as budget guidelines or mileposts, an agreement with 
the evaluators about what exactly is due when and what the closing procedures 
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are. C 'her housekeeping issues that would have been helpful to have clearly stated 
were what the grant requirements were for demographics which we could add onto 
for the sake of customizing. I wish we had as' )d for a home phone and workplace 
mailing address for each employeeon our Demographics sheets. 

CLOSING THE PROJECT. We should have left enough time to ruminate over 
the evaluation with the business partners. Also we should have planned a panel 
or party for all the partners so that we would have a sense of closure at the end 
of the project. 



Coordinator's Report 
Columbia-Willamette Skill Builders Consortium 



Prepared by 

Wayne Werbel 
Mt. Hood Community College 



COORDINATOR SUMMARY REPORT 



I. PROGRAM IDENTm" WITHIN INSTITUTION 

Skill BuUders at Mt. Hood Community College is housed in The Center for 
Community and Ekjonomic Development. The Center serves as the focus 
for most of the college's external programs, (Community Education, 
Contracted Training for Busmess and Industry). However, Adult Basic 
and Developmental Education, as well as, social service type programs 
(Welfare Reform, Dislocated Worker) provided the administrative and 
instructional staff for Skill Builders. This configuration created a strong 
institutional identity. Furthermore, hiring the Secretary of the College Business 
Officer and engaging the Associate Dean of Mathematics as a Skill Builder 
instructor enabled increased credibility. Skill Builders was featured in 
College Advancement publications and was profiled to the College Board as part of 
the May meeting concerning literacy. 

II. PROGRAM FIT AND INTERDEPARTMENTAL RELATIONS 

The college has offered basic skills instruction to business and industry 
(Language, Math, Reading, etc.) via its Developmental Education, ESL, and 
Contracted TVaining departments. The traditional disciplines (Mathematics, 
English, Voc Ed) did not offer training outside the campus and its satellite locations. 
The Skill Builders established two off campus learning centers (Carpenters and 
Teamsters) thereby not impacting on limited college space. The college no longer 
offered apprenticeship training and there was no overlap in vocational 
offerings. 

The Skill Builders received indirect staff support from the Director of Adult 
Basic Education whose involvement assured acquisition of qualiiy staff, as well 
as the institution of management/ coordination structures that supported 
quality instruction. The Director of the Center, known for irmovativeness and 
entrepreneurial energy, promoted the program and emphasized assertaining "FTE" 
statistics to demonstrate the value of Oie effort to the institution. 

III. STAFFING ISSUES 

There are difficulties working with an instructional staff that is limited by the 
college's part-time teacher ceiling of 12 hours per week. A program of part-time staff 
is inherently difficult to coordinate. Fortunately, the staff is excellent. They have 
. remained unchanged since the beginning of the program having performed initial 
assessment, developed instructional materials, and delivered training. The staff were 
cross-trained in each field (carpentry, truck driving and manufacturing) to enable 
greater flexibility and group perspectives in problem solving. 
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IV. 



LOGISTICAL CONCERNS 



In consideration of the limited amount of staff time and large scope of work, making 
time to meet often conflicted with times that instruction occurred. The part- time 
staff truly maximized hours; when instruction required only one person, other staff 
developed curriculum for ongoing projects. 

V. COORDINATION AND CONSORTIUM 

The consortium enabled three coinmunity colleges to work together to advance 
Workplace Uteracy. The initial coordination meetings with instructors iUustrated 
the breadth of our common efforts. Fifteen people working with many companies 
sharing similar start-up problems. The cooperation enabled us to share staff 
resources between colleges. The consortium formally offered training on many 
occasions via Jorle Philippi and others. The Northwest Regional Educational Labora 
tory operation role was unclear. While it was designated as Project Manager, the 
"real" management was within the coUeges. The lab played an exceUent'conven 
ing and dissemination role. 

VI. ADVANTAGES OF CONSORTIUM MODEL 

The primary advantage for our model was that we could address a SMSA without 
being confined to geographical limitations placed by coUege boundary area. 
Employers and v/orkers need not be limited by college district. Secondly each 

school specialized in an area - labor-based project, manufacturing, small business. 

The consortium enabled teachers to work multiple programs thereby enabling 

earnings beyond the 12 hour limitation and still staying part of ttie same system. 

VII. DISADVANTAGES OF THE NEW CONSORTIUM MODEL 

The leadership in the SkiU BuUders came at the program or intra-coUege level 
While the consortium maintained an umbreUa for the receipt of grant funds, 
a majority of tiie acti\aty was generated by instinctors and tiie business and 
labor partners. The roles of director and grant adminlsti-ator. as specified in the 
proposal, were unclear during tiie operation of the program. Resources were 
primarily devoted to delivery of services. The consortium, while good in concept 
required ongoing development and maintenance of effort. While tiie consortium' 
operated prior to tiie DOE grant, once ftjnded. tiie consortium became consumed by 
the grant. Very littie tiiought and effort was put into diversifying funding or planning 
tiie consortiums luture. The barriers to working togetiier still existed: distilct bound 
aries. marginal buy-in by tiie coUeges (no college funding), supporting a consortium 
model. Each individual institution operated differentiy tiiereby limiting tiie develop 
ment of a unified or integrated system after grant funding. The consortium did for a 
time allow for closer cooperation tiian is usually typical in. joint efforts. This is how 
ever, more reflective of tiie individuals involved from tiie respective institutions' tiian 
the institutions or the consortium. 
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VIII. CRITICAL AREA FOR IMPROVEMENT 

The initial proposal projected timelines to initiate services to business, 'ilie upfront 
development, task analysis, and curriculum development required a greater amount 
of time than was initially planned. The measures of success or desired outcomes as 
initially discussed in the proposal were different in the final analysis. Often the needs 
of learners and constraints of the workplace directed instruction, as it should be. 

In selecting partners, greater consideration should be given to the size of the com- 
pany or organization. While we received support from top management, the active 
involvement from line and middle managers was required to implement services. 
Therefore, while larger enterprises on the surface appear to be ideal candidates for 
workplace literacy programs, small and midsize organizations seem more manageable 
for the delivery of instruction. 

The area of instructor compensation is extremely critical. Firstly, this college has a 
self-imposed limit of 12 houis per week for part-time instructors. Secondly, the 
college pays $18 per instructional hour. The other colleges pay more and one 
consortium partner has no ceiling on instructor hours. More importantly, good 
instructors are easily absorbed by industry or by full-time facuty positions when 
available. Lastly, part-time instructors receive few benefits. Therefore, developing a 
solid instructional staff required more resources and greater institutional flexibility. 

With the end of the grant in sight, the consortium and workplace literacy programs 
at the colleges are unlikely to continue in their present form. Currently, marketing 
and technical assistance is targeted at businesses who communicate need for basic 
skill instruction in the workplace. The college workplace literacy coordinators are 
responsible for such efforts. Referrals come from Northwest Regional Educational 
Laboratory as a result of inquiries from the Skill Builder newletter. Other contacts 
come from college staff in developmental education and contracted training for 
business and industry. Once the federal funding is gone, the Northwest Regional 
Educational Laboratory will no longer produce the newsletter and their clearinghouse 
role will become limited. Furthermore, the college will no longer have a designated 
workplace literacy coordinator to respond to service requests for program and 
instructional development. 

Our request for Department of Education Workplace Literacy grant additional fund 
ing met a sad ending with elimination based on an unsigned partnership agreement 
fr om an entity described in the proposal as an affiliate in the abstract but a partner 
in the text. Sadly, the developmental efforts of many schools, businesses and unions 
in the Portland Metro area greatly suffered by the elimination, not to mention that 
wind was taken out of the consortium's sails. The college did submit a proposal to 
the US Department of Education Commercial Drivers Education Program which will 
allow continuation of the partnership activities with Teamsters. In tlie final analysis, 
federal resources enabled the community colleges in the Portland Metropolitan area 
to experiment and develop capacity to offer functional context basic skills instruction 
to business and lobor. 
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SKILLBUILDERS GRANT 



A Report to Steve Reder 
By Nikki Sullivan 

PROGRAM IDFNT.TY WITH TN TNSTTTUTION 

Workplace Literacy Programs (WLP) began in October, 1988 when the 
ABE/GED/ESL Department established a GED program at Portland Meadows Race 
Track. As more companies began to inquire about services, an internal curriculum 
project was approved to design a process for establishing WLP for the department. 1 
was followed by a joint 353 grant in which Clackamas Community College and PCC 
worked together to design a system for establishing WLP throughout the entire state 
system. In October of 1989, an eight hour per week release-time was granted to an 
ABE/GED instructor to continue to develop PCC WLP. 



PROGRAM FIT AND COLLABORATION W TTH OTHER PROGRAMS 

Initially WLP were developed and delivered from the ABE/GE/ESL department. 
In October 1989, the ABE/GED instructor moved to the Institute for Employee 
Development, the department at PCC responsible for separate comracts. lED had the 
expertise in marketing and contracting; ABE/GED/ESL had the expertise in content and 
instructors. It was felt this would be the most successful way to deliver WLP. The 
Skillbuilders Grant also led the way in building up interaction between the three major 
metropolitan community colleges. It was hoped that eventually the consortium 
would be responsible for the delivery of all WLP within the metropolitan area. 
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STAFFING ISSUES 

The major issue with staff concerns the difficulties that arise from the need 
to use part-time instructors. Our college has a union contract which limits instructors to 
twelve hour weeks with no benefits. This caused instability and lack of cominuity as 
many instructors left to take on full-time work elsewhere. 

Three of the instructors trained by Jori Philippi in task analysis left the project 
taking with them that knowledge. They also took with them the company "relationship" 
that had been buih up over several momhs of work. Consequently both programs 
suffered as new instructors had less training and less opportunity to credte new 
relationships. 

As coordinator, my time was severely limited. During the summer I was able to 
devote many hours to the grant, but when school started I was limited to eight hours per 
week. These hours were also spent working with several other WLP that had been 
developed. Since my time was limited to l-3pm Monday through Thursday, It was very 
difficuh to make arrangements to visit companies, hire, train and supervise instructors. 

Much of the work done by instructors required them to work on their own time. 
As dedicated teachers they absorbed a great deal of the work. Because of the limited 
time of both the instructors and the project coordinator a great deal of the "relationship" 
work was carried on by the instructor since they were housed at the company sites. 

Companies also faced personnel losses and changes as their employees left for 
other jobs or new employment. Tnis constant change is both company and college 
personnel created some real problems throughout the life of this project. 

It seems ironic to try to educate workers in the basic skills they need by using a 
work force made up of part-time workers who have less security and benefits than the 
workers they are teaching. 
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I.OGISTICAL CONCERNS 



It was almost impossible to be able to meet with company representatives, support 
instructors, and provide resources and materials and help in curriculum design on only 
eight hours per week. Physically it was difficult to travel to the company sites and it was 
very difficult to schedule meetings in which all the necessary parties could be present. In 
addition to serving as project coordinator, I was also working on a state grant for the 
plastics industry and had several other companies. Since I had to teach my morning 
classes it was not possible to juggle my schedule to make company appointments etc. 
Much of the work with instructors took place at night and over week-ends or at 
marathon sessions in one day. 



TIME LINES 

Because the grant was so late in being awarded, our whole time line at our 
companies was thrown off. By the time we were able to start many of our companies 
were in peak production times or laying workers off. It was really difficult to get things 
in "sync" and I'm not sure we ever did. Because we were so late and because it took us 
more time to write the customized curriculum it seemed like we were never really "on- 
time." 



rniVfPANY REPRESENTATIVES 

I developed all the initial contacts with the three PCC partners and attended 
several meetings in which initial plans were discussed. I met with workers, supervisors 
and management to discuss company needs. I also took tours of the facilities and talked 
at length about company needs and the areas most likely to be served under the grant. 
Then by the time the grant was awarded, I was working again and had to hire the 
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instructors for this project. Fortunately all of them had prior experience in WLP. So I 
accompanied all of the instructors, introduced them to the company representatives and 
helped them get established. From that time on much of the continued work with the 
company representatives was done by the instructors. In all three of our companies the 
initial contact person changed. Much of the development, knowledge, and history was 
lost as the company assigned someone else to work with us. This created continuity 
problems as the programs progressed. 

COMPANY VRS GRANT EXPECTATIONS 

The grant we applied for and the one we finally received were quite different. 
After lengthy phcne negotiations some things were redefined and some were totally 
eliminated. In addition, the time lines were all changed by the time we got the grant. So 
this had a major impact on what we were able to do. It wasn't clear until our August 
meeting with our outside evaluator how strongly our grant was tied to task analysis a 
process that was somewhat new to us and turned out to be veiy difficult to use at our 
ESL companies. 

Many of the ESL workers felt offended by this approach. They took a great deal 
of pride in their work and felt this class was not appropriate. They really wanted to 
study English for use outside of their work. 

Many of our union workers were also unclear as to how a WLP would help them 
get promotions-something that they felt was clearly defined by seniority and union 
contracts. 

All of our companies at least initially did not see the value of paid and/or release 
time for this training so consequently many workers choose not to attend on their own 
time. 
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COORDINATION AND COLLABORATION AMONG CONSORTIUM 
MEMBERS 



ITiere is something to be said for networking and support. I think the monthly 
meetings were invaluable; it was important to share concerns, frustrations, and successes. 
As we proceeded through the grant we continued to do staff development for instructors 
as well as the coordinators. After several meetings the coordinators and director began 
to meet separately to discuss issues, such as budgets training etc. I wish we had held , 
more meetings and had received more training. 

I think it would have been very helpful if we had received a clear cut job 
description and better guidelines for developing our programs. This is especially true 
concerning the absolute requirements of the grant as well as the needs of the outside 
evaluator. 



ADVANTAGES OF THE CONSORTIUM 

1. Identifying and training qualified instructors and curriculum developers we 
could all share. 

2. Identifying special issues that we were interested in to avoid duplication of 
efforts. 

3. Designing curriculums that could be shared. 

4. Responding to various needs of our companies in a collaborative manner 
(by sharing information and knowledge about what was working). 

5. Sharing resources on major issues such as recruitment, 
assessment, curriculum and evaluation. 
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DISADVANTAGES OF CONSORTIUM 



1. Limitations imposed by institutional requirements (part-time help, no 
general fund monies, territory issues). 

2. Lack of time and training for instructors and coordinators. 

3. Lack of clarification and definition of all roles and positions. 

4. Lack of clear guide lines and time lines fxr development delivery and 
evaluation of programs. 

5. Disparity between budget designs used in individual colleges and difficulty 
in accessing clear information. 



CRITICAL AREAS FOR IMPROVEMENT 

1. Part-time instruction. 

2. General fund support of WLP. 

3. Training and Staff Development. 

4. More release time for coordinator. 

5. Continued development in areas of curriculum, assessment, recruitment and 
evaluation. 

6. More participation by business partners. 
Establishment or guidelines and time-lines to produce necessary reports. 
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8. Better communication between all members or the Consortium. 
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Training enhances worltpiace skills 



* Imagine you * re a warehouse worker 
with 20 years of experience. You 
know where merchandise is stored, 
and you know the quickest route to get 
to it You handle a forklift like Steffl 
Graf handles d tennis racquet. 

You've proven lime and again that 
you*re reliable, efficient, and able to 
follow orders. You make decent 
money, enjoy your co-workers, and 
have always felt secure in you job. 

That was before word came down 
about the computers. You'll have to 
learn how to operate them, to read 
instructions and work orders, to locate 
merchandise in the re-designed ware- 
house, to order stock when it's low, 
and to collaborate with other employ- 
ees in newly formed "work groups." 
Suddenly, the warehouse that's been 
as familiar as home for two decades is 



a forbidding place. 

And while your bosses have prom- 
ised training to learn the new system, 
you feel that your world is coming 
apart 

That scenario, while fictitious, is not 
all that far-fetched. Veteran workers 
throughout the country are threatened 
by changes in the workplace. But it 
needn't be that way. Some companies 
- although it would be stretching the 
truth to say a lot of companies - have 
begun system wide reforms aimed at 
strengthening workerrolesand respon- 
sibilities with an emphasis on 
workplace literacy and training. 

The need for job-related literacy 
training is widespread, says Daniel 
Marschall of the AFL-CIO's Human 
Relations Development Institute. "We 
have to look more carefully, do a lot 



more research, and really develop this 
area of on-the-job training in a struc- 
tured and systematic way,'* he says. 
And, he adds, there is a critical role for 
"workers training and teaching one 
another in the context of the workplace, 
and in an environment that also values 
continuous learning/* 

Such workplace training is not lim- 
ited to the veteran employee who feels 
threatened by automation. 

Many entry-level workers are ill- 
prepared to perform the high-level skills 
required in today's workforce. Some 
are high school dropouts. Others are 
marginal graduates. All place aburden 
on employers, public institutions, and 
society. "Even among those who 
graduate from high school, it is esti- 
mated that one in six may be function- 

Contlnuad on Pagt 3 



Consortium links industry, iabor, education 



In Oregon, as elsewhere in 
America, advanced technol- 
ogy and tough licensing laws 
are radically altering even the 
most rudimentary kinds of 
work. 

On the assembly line, in 
the warehouse, or at the con- 
suuclion site, the worker who 
can 't keep pace with changes 
in the workplace faces stag- 
nation or, worse, unemploy- 
ment. 

To heip workers succeed 
and advance in their careers 
- and to help employers 
compete and profit in the 
marketplace - a network of 
Oregon community colleges, 
businesses, labor unions and 
educational consultants have 
linked up to form the Colum- 



bia- Willamette Skill Build- 
ers Consortium. The 18 
consortium members have 
forged partner- 
ships to train 
300 workers in 
job-specific 
basic skills. 

The 18- 
month demon- 
stration proj- 
ect, funded by 
a $399,000 
U.S. Depart- 
memofEduca- 
tion grant and matched by 
$227,000 of in*kind contri- 
butions from thepartners, will 
focus on northwest Oregon, 
primarily the Portland met- 
ropolitan area. Three com- 
munity colleges Portland, 



Mt. Hood, and Clackamas - 
will work with eight busi- 
nesses and industry associa- 



^Th9 purpose of the 
consortium is to develop 
training that is appropriate to 
these industries, all of which 
are i<ey to northwest 
Oregon's economy.^ 

'-St0V0R0dw 



tions and six labor organiza- 
tions to address the workplace 
literacy needs in the fields of 
carpentry and construction, 
food products, heavy manu- 
facturing, small business light 
manufacturing. trucking,and 



warehousing. The Northwest 
Regional Educational Labo- 
ratory is providing overall 
project design, coordination, 
and technical assistance. 

"The purpose of the con- 
sortium is to develop train- 
ing that isappropriate to these 
industries, all of which are 
key to northwest Oregon's 
economy,'* notes Skill Bui Id- 
ers project coordinator 
Stephen Reder, director of 
NWREL's Literacy, Lan- 
guage, and Communication 
Program. 'The training will 
be a mixture of job skills and 
basic skills.** 

The consortium * s business 
partners have identified spe- 
cific areas of their industries 
Contlnuad on Paga 2 
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'America's Choice' detaiis options for future worl<place 




mcrica is headed toward an 
••economic cllfr that could 
widen the gap between •'haves" 
and ••have nots" in society unless em<* 
ployers change the way they do busi- 
ness, warn the authors of America's 
Choice: High Skills or Low Wages! 

••If basic changes are not made, real 
wages will continue to fall, especially 
for the majority who do not graduate 
from four-year colleges," the report 
from the National Center on Education 
and the Economy notes. "'The gap be- 
tween economic •haves* and •havenois' 
will widen still further and social ten- 
sions will deepen." 

To avoid such social and economic 
calamity, the report recommends that: 
• A national educational performance 
standard be set for all students, to be met 
by age 16. This standard should be 



bcnchmarked to (he highest in the world. • A system of Employment andTrain- 

• Statestakerefsponsibilityforassur- ing Boards be established by federal 

ing that virtually all students achieve aftd state governments, together with 

the Certificate of Initial Mastery, the local leadership, to organize and 

Through the creation of local Employ- oversee the new school-to-work ^ansi- 

mentandTraining Boards, states, ' ^ ^ 



wi th federal assistance, create and 
fund alternative Icami ng environ- 
ments for those who cannot attain 
the certificate in regular schools. 

- A system of Technical and 
Professional Certificates and 
associate's degrees be created for 
the majority of students and adult 
workers who do not pursue a bac- 
calaureate degree. 

" All employers be given incentives 
and assistance to invest in further edu- 
cation and training of workers and to 
pursue high productivity forms of work 
organi7.ation. 



^If basic chahg^^^d'hdlmild^ 
real wages will continue to fall 
The gap between dcbnbmlc: .^^^ i 
•haves' and 'have nots' will r> 
widen still further and social;': ' 
tensions will deepen,' : i 



tion programs and training systems. 

To order the full report, send $18 to 
the National Center on Education and 
the Economy, PO Box 106 ?0, Roches- 
ter, New York 14610. 



Partnerships strengthen workers, workplace 



from Pagt 1 

where rising basic skills re- 
quirements are jeopardizing 
the job security of current 
and future workers as wel 1 as 
the long-tenn and short-term 
ability of the industries to 
remain competitive. 

The labor parmers have 
idcntined testing and certifi- 
cation requirements that their 
members must be trained to 
meet. Examples of areas 
workers and businesses are 
working to Improve are: 

• Production operators at 
Oregon Cutting Systems are 
improving basic skills in sta- 
tistics, writing, reading, math 
and computer use; 

• Increased requirements 
in the new federal licensing 
standards for the trucking 
industry may keep as many 
as 30 percent of truck drivers 
off the road if they do not 
fmd ways to improve their 
basic skills and pass the cer- 
tiHcation exam; and 

• Introduction of new pro- 
duction technology at Na- 
bisco« Inc., requires line 
employees to become com- 
puter literate. Employees also 



will need to improve their 
problem-solving skills. 

Clackamas Community 
College is working with a 
major manufacturing firm - 
Oregon Cutting Systems -to 
design customized curricula 
for the company. 

A similar project is in its 
early stages with another 



major manufacturing Arm, 
Precision Castparts. Train- 
ing is being offered through 
classes and individual, self- 
paced study, either at home, 
at the worksite, or at the 
college's Targeted Learning 
Center. 

Mt. Hood Community 
College offers classes both 



Consortium enlists 18 participants 
from labor, Industry, education 

Consortium members are: Associated General Con* 
tractors of America, InCi Oregon-Columbia Chapter 
Clackamas Community College; FredMeyer,Inc.;Int8r- 
national Brotherhood of Teamsters, ChauffeurSi Ware* 
housemen & Helpers of America, Union Local No. 162 
and Uni(Ni Local No. 206; JointCouncil of Teamsteft No. 
37; Leupold & Stevens, Inc.; LWO Corp.; ML Hood 
Community CoUege; Nabisco^ Inc.; Northwest Oregon 
Labor Council, AFL-GO; Northwest Regional Educa* 
tional Laboratory; Oregon Cutdng Systems; Oregon 
Office of Community College Services; Oregon Thicb 
ing Associations, Inc.; Oregon-Washington Carpenters/ 
Employers Apprenticeship and Training Trust; Pirecisidn 
Cas4)artsCorp.;PortlandCommunityCollege;andUnited 
Brotherhood of Carpenters A Joiners of America, Local 
Union No. 247. 



on campus and at union halls 
to carpenters and general 
construction workers, truck 
drivers, and warehouse work- 
ers. Carpenters and construc- 
tion workers can take classes 
on subjects such as reading 
blueprints, usingcalculators, 
construction measurements, 
and understanding docu- 
ments and speciHcations. 

Courses for truck drivers 
include training for a number 
of mandatory exams in such 
topics as air brakes and haz- 
ardous materials identifica* 
tion . Warehouse workers are 
taking instruction to prepare 
for future automadon. 

Portland Community Col- 
lege is designing curricula 
for teaching job-related ba- 
sic skills to workers at Na- 
bisco, LWO Corp., and I^c- 
upold & Stevens, Inc., the 
college's small business 
manufacturing and food 
products partners. 

Training addresses such 
issues as on-the-job commu- 
nication skills, team build- 
ing, job advancement, and 
changing technologies. 
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four general goals: quality perfonn* 
ance and services, con tinuousimprove- 
ment, worker participation, and life- 
long learning. 

The process involves "elimination 
of a whole lot of bureaiKratic, mid- 
level managers as well as introduction 
of self-managed workforces," notes 
Marsha Congdon, CEO of US West 
Oregon. "It means helping our peop*-* 
to learn to be coaches and knowir . 
what it means to be a part of a self- 
managed work team." 



•We have to 
really develop 
this area of on- 
the-job training 
in a structured 
and systematic 
way-' 

- Daniel Marschall 
AFL-CIO 




Successful programs Improve workers' job skills 

Continued from Piflt 1 

ally illiterate," note ThomasStichtand 
Barbara McDonald in Making the 
Nation Smarter, a report published by 
Applied Behavioral and Cognitive 
Sciences, Inc., of San Diego. "Low 
literacy levels are related to unem- 
ployment, welfare and poverty. These 
problems are considered to contribute 
to low productivity in the workplace, 
which is a large concern as the United 
States appears to be losing its competi- 
tive edge in the world marketplace." 

The prob lem s are compounded when 
one considers that the growth 
in population is among minor- 
ity youth, who, the authors 
say, are ''the very group thai 
constitutes the largest percent- 
age of dropouts, unemployed, 
and welfare and poverty 
groups." If the pattern contin- 
ues, "there will be an ever- 
widening gap between the 
haves and ihe have-nots.'* 

That sentiment was echoed 
by Ira Magaziner at a recent 
conference in Portland. 
"Today, we have the most 
unequal distribution of income 
of the 22 industrialized coun- 
tries of the world,'* said Mag- 
aziner, Chair of the Commis- 
sion on the Skills of the Ameri* 
can Workforce. 

"If basic changes are not 
made, real wages will con- 
tinue to fall, especially for the 
majority who do not graduate 
from four- year colleges. The 
gap between economic 'haves' and 
'havenots* will widen still further and 
social tensions will deepen," warns the 
Commission in Americans Choice: 
High Skills or Low Wages! 

Among the Commission's recom- 
mendations is one that would provide 
incentives and assistance to employers 
who invest ineducation and trainingof 
their workers and pursue high produc- 
tivity forms of work organization. 
Already, some companies arc involved 
in far-reaching workforce training and 
restructuring of the workplace. 

At US West Communications in 
Oregon, union employees and man- 
agement have been working toward 



•It means 
(learning) to be 
a part of a self- 
managed work 
team.' 

- Marsha Congdon 
CEO, US Wttdt 



Educators, too, are seeking ways to 
better prepare young people for the 
workplace. But there are barriers that 
must come down and stronger bridges 
that must be built, says Portland Public 
Schools Superintendent Matthew 
Prophet. In planning for the 1990s, the 
Portland district found that some of its 
technology equipment and materials 
were World War II surplus. 

Schools, Prophet says, are unable to 
purchase the high-tech equipment to 
properly train students. Whatisneeded, 
he adds« are stronger links between 
schools and business* industry, serv- 
ice, and labor organi/iitions to provide 
students a training ground with state- 



of-tlie-art equipment and employees 
who know how to use it 

Jorie Philippi, an expert on 
workplace literacy training, adds that 
entry-level workers need training for 
today*sjobs. And, she says, that train- 
ing needs to address job-related skills. 

PhiUppi says that the growing num* 
ber of "intermediate literates** - those 
who read at about the 6th*7th grade 
level - have special learning needs 
that must be addressed in the 
workplace. 'These special workplace 
applications of basic skills are 
generic to many different oc- 
cupations," she notes in Devel- 
oping Instruction for 
Worl^orce Literacy Programs, 
a publicadon of Perfonnance 
Plus Learning Consultants, Inc, 
of Springfield, Va. Applica- 
tions include: 

• Job reading processes for 
locating information and using 
higher level thinking strategies 
to problem solve; 

• Occupational writing proc- 
esses fororganizingclear, read- 
able writing, and for mastering 
thinking skills which enable 
analysis, elaboration, and ex- 
tension of written ideas; and 

• Workplace applicadons of 
math processes for calculating 
informadon and solving prob- 
lems that enable workers to 
acquire proficiency levels in 
reasoning and interpretation. 

"Successful workforce liter- 
acy programs need to focus on literacy 
tasks that workers encounter regularly 
on the job,** Philippi says. "And the 
measure of program success is not in 
terms of grade-level gains or GED test 
scores or other academic achievement 
statisdcs - it is determined instead by 
the amount of postprogram improve- 
ment in Job performance demonstrated 
by participating employees/' 

The Columbia-Willamette Skill 
Builders Consortium is seeking just 
such a marriage between workforce 
literacy and workplace skills. Future 
edidonsof Skill Builders will focuson 
programs at some of the eight partici- 
pating worksites. 



Additional reading 



The Tollowing are some or the publications that address 
issues related to workplace literacy and basic skills training 
in the context or the woikplace. 

An America That Works: The Life-Cycle Approach to a 
Competitive Work Force, by the Research and Policy Com- 
mittee of ihe Com mittee for Econom ic Development (CED), 
New York, 1990. Comprehensive framework for examin- 
ing the relationship between sweeping demograph Ic changes 
and the world of work. Provides examples of specific 
company programs designed to create opportunities and 
incentives for individual workers to continue to learn, grow 
and be productive. Makes recommendations for public and 
private policy changes to prepare youth for rewarding 
working lives, help adults be self-sufficient and socially re- 
sponsible through productive work and skill renewal, ?.nd 
keep older citizens active and independent. Available from 
CED. (202) 688-2063. 

The Bottom Line: Basic Skills in the Workplace, Wash- 
ington, D.C.: U.S. Department of Education and the U.S. 
Department of Labor, 1988. Provides guidelines for setting 
up workplace literacy programs. Presents brief overview of 
changes in the workplace and workforce; describes five 
general steps to perform a literacy audit and to determine 
job-specific basic skills requirements and whether the 
workforce has those skills; and focuses on steps to solve 
workplace literacy problems, including design of the train- 
ing, goals, available resources, recruitment, partnerships, 
curriculum, and evaluation. Good section on additional 



sources of information. Available from the Government 
Printing Office Book Store, Portland, (503) 221-6217. 

Worker-Centered Learning: A Union Gmde to Workplace 
Literacy, by Anthony R. Sarmiento and Ann Kay, AFL- 
CIO Human Resources Development Institute, Washing- 
ton, D.C., 1990. Clearly presented guide to developing 
effective workplace literacy training based on woikers* 
needs, learning styles and interests. Addresses the problem 
of defining and understanding "workplace literacy" with 
information on common misconceptions. Provides nine 
steps for designing worker-centered programs (iliat benefit 
employers, too). Offers guidelines valuable for any 
workplace literacy program, whether u«'ion-based or not. 
Available from AFL-CIO Human Resources Development 
Institute, (202) 638-3912. 

Workplace Basks: The Essential Skills Employers Want 
and Workplace Basics Training Manual, by Anthony P. 
Camavale, Leila J. Gainer, and Ann S. Meltzer, American 
Society for Training and Development (ASTD), Jossey- 
Bass Publishers, San Francisco, 1990. Comprehensive 
discussion of skills needed for today's rapidly changing 
work worid, and step-by-siep manual for assessing the need 
for developing and implementing performance-based, 
functional context training programs. Needed skills in- 
clude: learning how to learn; reading, writing and compu- 
tation; speaking and listening; solving problems and think- 
ing creatively; managing personal and professional growth; 
working with others; and leadership and influence skills. 
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Workplace skills training involves 'joint survival' 

Functional context approach relies on support, cooperation 
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If forts to provide 
jjob-oricntcd basic 
I skills training for 
lemployees need 
I the support and 
cooperation of a long list of 
players - from the chief ex- 
ecutive officer to mid-levcl 
managers to union leaders to 
individual workers. 

If any of the participants 
drop out, the training program 
could crumble, cautions Jorie 
Philippi, an expert in func- 
tional context education and 
a consultant to the Columbi a- 
Willamette Skill Builders 
Consortium. "Building a 
partnershipis not an easy tiling 
todo." Philippi says. "Itiakes 
patience, planning and for- 
mal communication." 

If the training program also 
involves college-level in- 
stmclors. the need for formal 
communication becomes 
even more acute. "Get in- 
volved with the educators 
early on," Philippi says. 
'They come from a different 
community and have differ- 
ent goals." 

The Skill Builders Consor- 
tium includes specially 
trained community college 
instructors who provide basic 
workplace skills training to 
employees from participating 
companies. That special 
training is necessary because 
of the different goals of the 
community college classroom 
and the company warehouse. 
"In an academic context, 
people read to learn things," 



Philippi says. "With func- 
tional context education, you 
read to do. You locate some- 
thing, and you use it." 

Functional context educa- 
tion is built upon the needs 
and goals of employers and is 
based on the tasks that em- 
ployees u.se on their jobs. An 
employer may seek to reduce 
mistakes, cut down on acci- 
dents, oreliminate waste. Or, 
a company may be going 
through a technological 
change that requires new skills 




competent people think in 
performing specific tasks," 
Philippi says "We can then 
build scaffolding for other 
employees to use." 

The idea is lo identify basic 
skills applications to use as 
instructional objectives in a 
job- opeci fie training program . 
For example, if workers need 
lo convert fractions to 
dccimals,they can learn to do 
so in a training program that 
uses their workplace experi- 
ences to illustrate the process. 

"The func- 
tional context 
approach 



mm 

functional 
context 
education, you 
read to do. 
You locate 
something, and 
you use it.* 

- Jorie Philippi 



of its employees. The idea, ready know." 
Philippi says, is to focus on 
one or two of the areas where 
improvement is sought and lo 
build a functional context 
program around them. 

The process involves inter- 
views with and observations 



builds on a 
worker's prior 
experience on 
the job," 
Philippi says. 
"It provides 
mental hooks 
for workers 
and validates 
what they al- 



Such workplace training 
can be used in large corpora- 
tions or small businesses, al- 
though partnerships involv- 
ing community colleges or 
othereducalional institutions 
need to be forged to make ilie 



of employees as they perform process affordable to smaller 

theirjobs. This "literacy task companies, 

analysis" provides clarifica- For example, a community 

tion of the job-performing college that offers a couree in 

thinking strategies that the blueprint reading could dc- 

workers u.se and lays the sign the material to meet the 

foundation to develop a Tunc- job-related needs of small 

tional context curriculum. companies. "We'rtj looking 

"We want to see how at the community colleges to 



become regional providers to 
increase the cost-effective- 
ness for smaller companies," 
Philippi says. 

Philippi is executive direc- 
tor and founder of Perfor- 
mance Plus Learning Con- 
sultants. Shehas provided job- 
training basic skills for orga- 
nizations ranging from the 
U.S. Anriy to Motorola, and 
developed a basic skills pro- 
gram for Hewlett Packard in 
Colonido to train all 1,400 of 
its employees using the func- 
tional context approach. 

At Moiorola in 
Schaumburg, Illinois, Philippi 
and four of her staff devel- 
oped two training progiams 
and outlined nine others that 
could be developed for 
woridwide marketing by the 
company. 

Such training programs arc 
becoming increasingly im- 
portant as workforce demo- 
graphics become more di- 
verse and as the workplace 
relies more on critical think- 
ing, communication, and 
high-tech skills of workers. 

"There are still employers 
out there who say, 'Send me 
the employee with the right 
attitude and Til teach him the 
job,'" Philippi says. Most 
employees, though, need a 
broader range of skills to ad- 
dress the needs of the rapidly 
changing workplace. 

"Such training," Philippi 
adds, "involves joint survival 
for the employee and the em- 
ployer." 



Nabisco undergoes workplace transfocniation. See inside \m^h. 
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Employees broaden skills as Nabisco 
shifts to high-tech production process 



n one room, laborers work in a 
cavemous arca amid 10-rooi 
tall, olive green cast iron ma- 
chines that knead and mix and 
shape the dough that will 
evolve into Oreo cookies, Ritz 
crackers or any of a variety or 
Nabisco products found on 
grocery shelves. 

The process is labor inten- 
sive: Workers hoistSO-pound 
sacks of flour and manually add them to the 
mixing bins, push carts full of ingredients 
around the floor, then hand-crank die rotors 
before engaging the steel blades that mix 
the dough. Each step is tended by workers 
who monitor the mixing process. 

'This plant was built in die I95()s, and 
most of the equipment you see is original," 
says Norman Fulmer, employee relations 
manager at die Nabisco Company plant in 
north Portland. 

But just a room away, the future i.s al 
work. Here, employees monitor computer 
screens il a well-lit room where stainless 
steel mixers gently whir ingredients into 
dough. Trainees — among them engineers, 
mixers, and maintenance and repair work- 
ers — huddle around a multi-colored 
computer screen and track each step in the 
high-tech baking process. In one of iho.se 
rare moments when the past meets die fu- 
ture, workers still manually empty dio.se 
50-pound .sacks into glistening bins, but it is 
a chore that will become obsolete when the 
computerized system is fully functional. 

Nabisco's shift from its 1950s, heavy 
machine, labor-intensive baking process to 
the high tech of die 1 990s is wel I under way. 
But during tlic iran.sition, the two decades 
must co-exist to allow producdon to con- 
tinue. 

It's as if Nabisco, the giant cookie and 
cracker company, is teetering on die brink 
of an industrial cusp. 

Such dramatic changes in die workplace 
involve much more than the technological 
advances diat streamline production and 
introduce sophisdcated equipment. The 
very nature of change in what has been a 
highly structured workplace can eremite 
anxiety and insecurity among employees. 



In the past, workers were responsible for 
single ta.sks: a mixer, for example, would 
have little cau.sc to be familiar with Uic 
responsibilities of a maintenance and repair 
worker or a baking crew member. The job 
might require a strong back, die ability to 
follow orders, and die insight to report 
malfunctions to supervisors. 

With die new technology, diough, em- 
ployees must be familiar with all aspects of 
the baking process, un- 
derstand workplace 
computers, trouble- 
shoot problems, convert 
math concepts and use 
calculators, read techni- 
cal instructions, and 
comni unicaic with odier 
workers throughout the 
plant. 

"We'reirying Inbreak 
down barriers among die 
variou.sjohs here lo have 
the employees work in 
teams," notes Fulmer. 
"While we have the 
technological changes 
occurring, we're al.so 
going dirough a social 
change." 



ment is vital foremployees to improve their 
skills. "Most people need some extracur- 
ricular training fortheirjobs/'saysCawley. 
whose AFL-CIO affiliate represents 425 of 
die 520 employees at Nabisco. "So setdng 
up a program is no problem." 

What is essential is to guarantee employ- 
ees' confidentiality when diey seek help in 
basic woricplace skills and to cleariy com- 
municate the goals of die training. Most 




Among the key ingre- Suptrvlsor Terosa Watts rtvltwa a compultr program with trainc 



dients in the changes is Nabisco's partici 
pation in the Columbia-Willamette Skill 
Builders Consortium. Thecon.sortium is an 
1 8-mondi demonstradon project funded by 
a $399,000 U.S. Department of Educadon 
grant to Pordand Community College and 
matched by $227,000 of in-kind contribu- 
tions from odierconsortium members. (See 
Skill Builders, January 1991). 

At Nabisco, employees involved in the 
company's five-week technology and 
communication daining are first assessed 
for woricplace skills diat will be needed in 
die rapidly changing plant. That assess- 
ment idendfles math, reading, calculator 
U.SC, and other skills diat some employees 
need to bolster in order to work cffccdvely 
in die new Nabisco plant. 

Darrcll Cawley,.secrciary-trca.surErof die 
Bakery, Confectionery and Tobacco 
Workers Local 364, says .such an a.s.sess- 



employees, Cawley notes, need to brush up 
on math or other .skills. Others, diough, 
may not know how to read and arc embar- 
rassed lo admit it. "The secrets people 
have," he says, "dicy have kept well over 
the years." 

The assessments, which were initially 
given in groups, are now administered 
privately. Only the assessor and the student 
learn die individual's score. Skill Builders 
trainer Mary Smith meets widi workers 
confidendally to provide die job-specific 
skills that serve as a basic frameworic for 
the five-week Nabisco technology training. 

'This program," Smidi says, "provides 
a support system for employees before, 
during, and after technical training. The 
training involves basic skills, but widi a 
functional context that supports the new 
technology and die woricplace needs of 
Nabisco and its employees." 
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For example, Smith teaches what she 
alls "Nabisco math." The training focuses 
n use of fractions and decimals, math 
onversions, and other concepts necessary 
lUie mixing process. "We're covering an 
rganizational need for math skills," Smith 
ays. Training also involves job-related 
loblem-solving skills, study skills, rcad- 
ig. and computer use. 
In the past, says Fulmer, mf^ny employ- 
es were able to perform their tasks by 
isually identifying it) 'icnts, feeling for 
ic proper texture of or using other 
:ills developed over Uie years. Now, those 
imc employees must also read and intcr- 
xt directions on a computer .screen, con- 
. vert fractions to deci- 
mals, use calculators, 
understand symbols, 
communicate with 
workers in other de- 
partments, and make 
decisions previously 
reserved for supervi- 
sors. 

Employees also must 
leam the language of 
computers. For ex- 
///* t 1 ample, if one has never 
'tlLf viewed a computer 

mm t*' screen, directions such 
as "Opcr Resp," "Inv 
Bins," and "Toggle" 
may be as foreigr as an 
unspoken language. 
Employees will view 
oLubenow the entire baking pro- 
son a computer screen and must leam 
V to respond to emergencies in any of the 
>artmenis at Nabisco. 
The computer now makes the dough," 
s Tere.sa Watts, a supervisor and trainer 
>labisco. *The employees do the think- 
. These guys are taking on a lot more 
X)nsibili ty, and they 're leaming to make 
isions." And fulfilling the training needs 
woikcrs suits the needs of labor and 
lagemcnt alike. Especial"- hen a plant 
loing through the drr jtic internal 
ngcs that Nabisco is ex, -..encing. 
iVIlhin the next five years, you could say 
's a new plant there, but nobcjdy in the 
;hbothood will notice it, ' tjOios union 
rscntative Cawley. 'They're looking 
ic team concept and every individual 
wing about every aspect of the product, 
"re trying to enhance everyone's skills 
)eet »hat objective." 



Trainer brings world of experience 
to functional context approach 



Mary Smith's 
background 
includes work, study 
in India and Iran 

Mary Smith has traveled the world 
.spreading the word about functional con- 
text learning and the benefits it can bring 
10 various cultures, workplaces, and 
situations. 

Smith, an adjunct faculty member at 
Portland Com- 
munity College 
and trainer in tlie 
Skill Builders 
Consortium, is 
preparing about 
50 workers at 
Nabisco to effec- 
tively work with 
the new, high- 
tech mixing op- 
eration that is 
emerging at the 
baking company 
in nortliPonland. 
Functional 



adult literacy program. What partici- 
pants gain are "special workplace appli- 
cations of basic skills (that) are generic to 
many different occupations," notes Jorie 
Philippi, a consultant to the Columbia- 
Willamette Skill Buildeis Consortium and 
an expert in woricplafje literary training. 

In addition to giving students a frame 
of reference for their leaming, functional 
context also provides a tangible reason 
for the student to absorb the new informa- 
tion. Forcxample, leaming how to convert 
fractions to decimals takes on new rel- 



*lf you're a good 
teacher, you're always 
using a functional 
context approach so 
your students can 
hang their hats on a 
concept that is familiar 
to them.' 
- Mary Smith 



context leaching. 

Smith says, provides students with a fa- evancc when it is applied to a woricplacc 

miliar framework to build upon. "You try where such conversions have become 

to tic the new information into the old," necessary because of advanced technol- 

shesay.s. Ifyou re a good teacher, you 're ogy. It isjust that type ofchange that the 

alwaysusingafunctionalcontextappiDach Nabisco Company in Portland is exoeri- 

.so that your s Jenis can hang Uieir hats encing. 

on a concept that is familiar to them." Smith as.ses.ses employees' skills in the 

bmith has used the functional context areas that will be necessary to develop in 

approach for much of iter 12 years as a Uie emerging high-tech workplace at 

teacher in public and private schools and Nabisco. If employees need to bolster 

in adult learning cemers. She also trav- the-r math skills, enhance reading skills 

elcdtolndiaonaFulbrightgrantaspartof such as skimming and scanning, or im- 

a 20-person team that woriced with adult prove computer skills. Smith worics with 

literacy pirigrams in that country. And, them individually or in groups prior to 

she brought the functional context ap- their entry into a five-wee!. technology 

proach to Iran, where she woriced for irainingprogramoffercdbytheemployer 

GT^SylvaniateachlngEnglishandother (Editor's Note: Feature stories on 

skillstorTicmbcr??oftheRoyalIranianAir other participants in the Columbia- 

/^L^r °! ^"l"^"^"- Willamette Skill Builder? Consonium will 

Functional context education is not job be included in fu'jrc issues of the Skill 

traming in the cla.ssic sense. Nor is it an Builders ne w.sletter ) 



Er|c r,: BEST COPY AVAILABLE 



Additional resources 



Workbook details 'functional context approach' 

Sfep-by-step instructions to provide worl<piace skills program 



ll is likely thai wiany employers will need to provide 
workplace skills training to an increasingly divergent group 
of employees who have little fomial education or who did 
pooriy in traditional educational set- 
tings. And with the rapid changes 
occurring in the workplace, it is also 
likely that many employers are seek- 
ing ways to train their workers to use 
equipment that was unimaginable 
until recent years. 

Providing workers with basic skills 
that arc needed to perform ilieir jobs 
effectively and efficicnUy is the basis 
of functional context education. But 
employers must first master the train- 
ing skills neces.sary to provide such 

training to their employees. The Business Council on 
Effective Literacy notes in its July 1990 newsletter, "Tlie 
importance of designing workplace programs and assess- 
ing learning skills in terms of 'functional context' is well 
established by research... But functional context education 
is a new concept for most literacy and education profes- 
sionals, indeed for businesses large and small...and few of 
ihem have the know-how to apply it." 

Literacy at Work: The Workbookfor Program Develop- 
ers has been produced to help employers plan, set up, and 



operate successful workplace literacy programs. 

The workbook provides detailed information on how to 
develop and use the "functional context approach" to 

implement workplace skills pro- 
grams. In addition, it contains 
practical basic skills training op- 
tions for learners at all levels as 
well as reasons for selecting one 
option over another in different 
situations. 

Designed specifically for busi- 
ness owners, personnel directors, 
human resource directors, techni- 
cal trainers, and others involved in 
creating workplace skills programs, 
the workbook features step-by-step 
instructions on how to develop workplace literacy program 
activities and materials, complete instructions on how to 
develop a functional context curriculum, and practiceexer- 
cises that allow the user to "try it and apply it." 

Developed by Jorie Philippi, founder and executive di- 
rector of Performance Plus Learning Consultants in 
Springfield, Virginia, (see related story, page 1), the work- 
book is available for $200 from Simon & Schuster, Inc., 
Workplace Resources, P.O. Box 1230, Westwood, New 
Jersey 07675-9855, (800) 223-2348. 



imporianje of designing 
workplace programs and 
assessing learning skills in 
terms of functional context' is 
well established by research, ^ 
- Business Council on Effective Literacy 
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Union-based programs meeting members' needs 

Skill Builders working with Teamsters, carpenters unions 



u 



Inion-bascd em- 
ployee education 
programs offer 
workers a trusted 
I and reliable envi- 
ronrnent to enhance their job 
skills and pursue other life- 
long learning goals, says a 
national labor leader and co- 
author of a union guide to 
workplace literacy. 

"Unions' education and 
training programs are rooted 
in the needs of their mem- 
bers, the learners," writes 
Anthony Sarmiento, assistant 
director of the AFL-CIO Hu- 
man Resources Development 
Institute in Washington, D.C. 
"Tlicy are worker-centered. 
This means that workers, 
through their union, have a 
central role in developing the 
programs. Their needs de- 
termine how the programs are 
desi gned , what they o ffer, and 
how they are taught." 
Sarmiento and Ann Kay are 
co-authors of Worker-Cen- 
tered Learning: A Union 
Guide to Workplace Literacy. 

The Columbia- Willamette 
Skill Builders Consortium 
collaborates with two union- 
based worker training pro- 
grams (see iaside pages). The 
collaboration provides func- 
tional context learning for 
Teamsters and entry-level 
carpenters who seek assis- 
tance beyond what their union 
already provides, says Wayne 
Werbel, coordinator of Mt. 
Hood Community College's 
participation in the Skill 



Builders Consortium. "We're 
responding to the needs that 
these unions are addressing," 
Werbel says. "We're not 
bringing in a pre-packaged 
plan, but designing custom 
plans based on their needs.'* 
Such worker-centered 
learning programs arc in their 
infancy in the Portland area. 
"We're still in the crawling 
stages in what we've been 
abletoaccomplish,"saysRon 
Fortune of the Northwest 
Oregon Labor Council. 



^Everyone benefits when 
workers have a chance to 
renew their skills to keep 
pace with change In the 
workplace.^ 

-Anthony Sarmiento 



"But," he adds, "we're doing 
well" in those programs that 
have begun. 

There have been rough 
spots to iron out at the pilot 
projects involved in the Skill 
Builders consortium. Atone 
site, worker confidentiality 
needed to be resolved between 
the union and management. 
At another site, scheduling 
has been important. "One 
thing we're finding,'* says 
Glenn Shuck of Labor Com- 
munity Services, "is that when 
classes arc scheduled only 
during the day, you're not 
going to reach as many 
people.'* As a result. Skill 



Builders trainers offer 
evening and daytime classes 
in conjunction with other 
union-based training scssi ons 
to reduce the amount of time 
workers spend away from 
family and friends. 

In his guide, Sarmiento 
says it is important to com- 
municate with workers about 
their needs for additional 
training or advanced learn- 
ing. And, he adds, it also is 
important for unions and 
management to communicate 
clearly and 
understand the 
purposes and 
goals of train- 
ing programs. 
"There must 
be a general 
understanding 
about what the 
respective 
roles of the 



union and employer will be," 
hewriies. "From this consen- 
sus, you and the employer 
can plan together how the 
program will be carried out" 
In their guide, Sarmiento 
and Kay outline nine keys to 
a worker-centered approach 
to learning that includes: 

• Build on what workers 
already know, an approach 
that focuses on workers* 
strengths, not their weak- 
nesses 

• Addrcssthcneedsofihe 
whole person: This approach 
recognizes that workers may 
want to enrich their capabili- 
ties as individuals, family 



members, trade unionists, and 
citizens; not just as employ- 
ees perfoimingajob 

• Woricer and union par- 
ticipation in developing and 
planning learning programs 

• Participatory decision- 
making 

• Equal access to and 
voluntary participation in 
educational programs 

• Curriculimi content and 
program structure that reflects 
the diverse learning styles and 
needs of adult workers 

• Woricer involvement in 
testing and assessment 

• Confidentiality 

• Literacy programs tiiat 
respond to anticipated work- 
place changes 

"Worker-centered doesn 't 
mean tiiatworicersaretheonly 
ones who benefit from this 
approach to learning," 
Sanniento says. "Their em- 
ployers gain, too. Manage- 
ment and labor alike benefit 
from expertise that woricere 
bring to designing and oper- 
ating their programs. Every- 
one benefits from workers' 
articulation of what tiiey need 
to learn and what they want to 
learn. Everyone gains from 
labor's experience with job- 
related skill training. Every- 
one benefits when workers 
have a chance to renew their 
skills tokeeppace withchange 
in the woricplace." 

To order Worker-Cen- 
tered Learning, see "Addi- 
tional Resources" section on 
the back page. 



Carpenters, truckers enhance skills in union-based programs. Sec inside pages. 
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Union halls provide 
inviting atmosphiere 
for workers to upgrade 
essential skills 



Grandpa was a carpenter 

He built houses and stores and banks 

Chain-smoked Camel cigarettes 

And hammered nails ami planks 

He was level on the level 

Shaved even every door 

He voted for Eisenhower 

'Cause Lincoln won the War. 

— John Prine 

Songwriter John Princ's tribute to his 
nail-drivin' granddad addresses a time when 
life was simple, issues were clear, and the 
nuclear Tamily was strong. 

Carpentry was a craft passed down from 
one generation to another, and carpenters 
were gifted with a seemingly innate ability 
lodetemiine angles, calculate complex math 
formulas, and convert measurements. To- 
day, though, 30 to 40 percent of entry-level 
carpenters in Oregon and Washington have 
had little or no experience in carpentry or 
oiherbuilding trades, says Garry Goodwin, 
director of instruction for the Oregon- 
Washington Carpenters/Employers Ap- 
prenticeship and Training Trust. 

"It's becoming more and more apparent 
that the days of following in your parents 
footsteps are gone," Goodwin says. "I 
guess it's part of the free-wheeling nature 
of young people today. But people come to 
us with little or no skills. That's what 
makes it interesting to train them." 

The carpenter's group linked up with the 
Columbia-Willamette Skill Builders Con- 
sortium to provide basic math skills as they 
apply to carpentry to entry-level candi- 
dates. "In the past four years," Goodwin 
says, "people seeking entry into the build- 
ing trades programs are lacking basic skills 
in mathematics, which is the foundation of 
our program. The Skill Builders meet the 
needs that we have. If the apprentice is 
stumbling in class, he or she can get special 
attention and tutoring." 

Mt. Hood Community College instructors 
Margie Taylor and Sandy Clawson provide 

o 
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ihe specialized functional context training 
in Skill Builders programs Tor both ihe 
carpenters and the International Brother- 
hood of Teamster^;, Chauffeurs, Ware- 
housemen & Helpers of America, Union 
Locals 162 and 206. Other partners include 
tlie United Brotherliood of Carpenters and 
Joiners of America Local 247, and tlie As- 
sociated General Contractors of America 
Inc. 

For the carpenters, the two instructors 
have rxjwrittep and reorganized math exer- 
cises that carpenters use daily in their work. 
Everything frum simple addition and sub- 
traction to determining right angles to 
converting fractions to decimals to figuring 
the area of various shapes are covered in the 
Skill Builders math labs. 

The carpenters center has about 650 ap- 
prentices enrolled in a four-year training 
program that leads to certification as a 
journeyman. Goodwin estimates that Skill 
Builders trainers have met in classrooms or 
small group settings with about 250 of 
them. "The Skill Builders provides the 
tutoring for those people who need the 
special instruction to get back into tlie 
mainstream," Goodwin says. 

In the program with the Teamsters, Skill 
Builders instructors are working with truck 
drivers to take a new - and tougher - com- 
mercial drivers license exam that all drivers 
must pass by April 1992. The federally 
mandated test will enhance truckers* skills 
and improve highway safety* says Gary 
Miller, benefits coordinator for Teamsters 
Local 162. 

*'Most of the drivers/' Miller says, *'are 
just tickled to death that this is coming 
down. They're scared of it, but they're glad 
to see it." Drivers' fears, he adds, are of 
taking tests, not mastering skills. "Devel- 
oping a test-taking strategy is very, very 
important. It's a matter of teaching the 
drivers to look at every word, knowing 
what they're reading, and retaining infor- 




Carpenter apprentices worK on a structure d 

mation." 

Truckers are a proud lot, Miller says, and 
welcome the opportunity to enhance their 
image and to upgrade their skills. "They get 
worried about theirimage. Drivers are very 
proud of what they do. They provide a vita! 
service to this country." 

Skill Builders instructors Clawson and 
Taylor help prepare drivers who seek ad- 
ditional assistance for a battery of tests. 
The type and number of tests that drivers 
must pass are determined by the type of 
commercial vehicles they drive. All driv- 
ers, though, must pass a general knowledge 
exam that serves as a framework for other 
specialized tests. 

The Teamster local provides a day-long 
seminar for drivers that concludes with the 
new CDL test. Drivers who do not pass 
often seek tutoring through the Skill Builders 
program. 

"We saw a need for additions' help for 
some of the people who couldn 't get through 
the book," Miller says. "TheSkiU Builder? 
was a natural place to go. With the seminar? 
and the Skill Builders tutoring, I don' t think 
there will be very many who won't pass." 

Drivers arc allowed to take an exam up to 
eight times, and must rctest only those 
exams they do not pass. For example, a 
driver could pass the general knowledge 
testbut fail hazardous materials. In order to 
transport such materials, the driver would 
have to retesl until passing. 

Union-based workforce skills training 




bring a week-long training exercise 

addresses the needs or workers in the 
changlngmarketplace, says Wayne Werbel, 
coordinator of Mt. Hood Community 
College's participation in the SIcill Builders 
Consortium and a workplace literacy spe- 
cialist with The Center for Community and 
Economic Development at the school. 

'There was a time when a strong back, a 
good woric ethic, and agile hands could get 
you a job," Werbel says. "People didn't 
care if you could read or write or calculate 
because it wasn't needed on the job." 

But those jobs are rapidly disappearing, 
and workers arc expected to operate com- 
puters, work in groups, communicate across 
Job lines, read, write, calculate, and make 
decisions that previously were reserved for 
supervisors. 

Skill Builders, which focuses on devel- 
oping a job-specific curriculum after con- 
fening with employees, managers, and la- 
bor representatives, can provide valuable 
training and build iho confidence of work- 
ers faced with a changing workplace. 

"We're responsive to the needs that 
woricers are raising," Werbel notes. "We 're 
not bringing in pre-packaged plans. We're 
designing custom plansbased on ihcirnceds. 
It's a functional context approach. 

"We're also helping people build confi- 
dence in their ability to leam, to develop 
self-esteem," Werijel adds. "Most of them 
have not had positive experiences with the 
education system. Skill Builders is really 
providing an outreach service." 
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Additional resources 



The following are some of the publications that address 
issues related to worker-centered literacy and basic skills 
training. For a more complete listing, see Worker- 
Centered Learning: A UnionGuidetoWorkplace Literacy, 
by Anthony Sanniento and Ann Kay, AFL-QO HRDI, 
Attention: Worlcplace Literacy, 815 16ih St. N.W., 
Washington, D.C., 1990. 

AFL-aO Committee on the Evolution of Work. The 
Changing Situation of Workers and Their Unions, 
Washington, D.C., February 1985. In this policy statement, 
the AFL-CIO looks to the future needs of workere in a 
changing workplace. 

AFL-CIO Departmentof Economic Research, "Training: 
A Key Role for Unions," AFL-CIO Reviews the Issues Series, 
Report No. 38, December 1989. This four-page paper 
summarizes how unions are using education and training as 
a tool to help their members as well as to recruit new ones. 
The paper describes negotiated education and training 
efforts in different industries. 

Alamprese, Judith. "Adult Literacy Research and 
Development: An Agenda for Action," Southport Institute 
for Policy Analysis, Southport, Conn., December 1988. 
Alamprese recommends a national agenda for research and 
development projects as a means of improving the theory 



and practice of adult basic education. She discusses the 
limitations of present grade-level tcstingtools formeasuring 
adult literacy levels and comments on alternative perfomi ance 
measures such as competency-based assessment systems 
and applied performance measures. 

Camevale, Anthony P., Leila J. Gainer, and Ann S. Meltzer. 
Worliplace Basics: The Skills Employers Want, American 
Society forTrainingand Development and U.S. Department 
of Labor, Washington, D.C., 1988. Written from a 
management perspective, i*5is research report acknowledges 
the importance of worker concurrence in workplace learning 
programs. 

Harman, David. Illiteracy: A National Dilemma, 
Cambridge Book Co., New York, 1987. Harman, an education 
professoratColumbia University Teachers College, discusses 
lessons learned form literacy programs, among them: that 
programs should relate to learners' personal goals; that peer 
support encourages learning; and that volunteer efforts alone 
can't solve the country's basic skills problems. 

Sarmiento, Anthony. "Woricplace Literacy and Woricplace 
Politics," WorkAmerica, National Alliance of Business, 
Washington, D.C., September 1989. Sarmiento discus.ses 
the dangers of literacy audits and the reasons why workers 
need to be involved in planning a woricplace literacy program. 
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Issues abound in workplace ESL programs 

Assessing needs of workers essential in developing programs 



f 



I he need for teaching 
English toa new and 
emerging American 
workforce will in- 
I crease dramatically 
in the coming years. And pro* 
gramsdevclopeidtoaddress those 
needs must go beyond the teach- 
ing of workplace English, says 
NikkiSullivan.chairorihe Adult 
Basic Education Department at 
Portland Community College. 

**English as a Second Lan- 
guage (ESL) is like an onion/' 
Sullivan says. "Every time you 
peel away a layer, you have an- 
other one to deal with.** 

Language i$ not the only 
barrier for immigrants in the 
workplace. Other issues in- 
volved in workplace ESL pro- 
grams include cultural differ- 
ences, historical conflicts, and 
educational disparities. 

**There are so many different 
people from so many different 
countries with such a wide range 
of educational experiences/' says 
Sullivan, a workplace literacy 
.specialist and coordinator of 
PCC's involvement in the Co- 
lumbia-Willamette Skill Build- 
ers Consortium. 

In addition to si/^able His- 
panic and Southeast Asian com- 
munities, the Pacific Northwest 
has an emerging central Euro- 
pean population. Immigrants 
from Romania, the Soviet Union , 
Czechoslovakia, and Yugosla- 
via are settling into the area, 
bringing with them a culture, 
work ethic, and lifestyle far dif- 
ferent from those of their new 
neighbors. 

Among the problems in es- 
tablishing a workplace ESL pro- 
gram, Sullivan notes, is that the 
various nadonalities have no way 



of communicating with each 
other. "There^s no way for the 
Southeast Asians to talk to the 
Russians or for the Russians to 
talk to the Chinese.*' 

When the cultural differences 
are considered, the difficulties 
are magnified. For example, the 
Vietnamese, Cambodians, and 
Laotians have been fighting in 
their native lands for years. In 
their new culture, they're ex- 
pected to overcome centuries of 
hostilities to work as team mem- 
bers on their jobs. 

And workers from the 



not considered a strength. *'The 
American culture understands 
theconceptofspeak up and speak 
out^" she says. "They have a 
system they can access. The 
ESL people are not in that sys- 
tem yet.** 

"Wecan go in and teach safety 
to workers," Sullivan says. "But 
in addidon to teaching them to 
read and understand safety signs, 
we have to get the workers to 
break out of that silence and ask 
questions of supervisors when 
they see something wrong.** 
Employers' demands of 
workers have 



^English as a second 
language is like an onion. 
Every time you peel kway a 
layer, you liave another one 
todealwith.^ 

-Nikki Sullivan 



emerging central European 
populations come from a culture 
where asking questions of au- 
thorities may have been hazard- 
ous to their health. **Romanians 
are coming out of one of the 
most repressive regimes in the 
last 25 years,** Sullivan says. In 
counuies where asking too many 
questions could result in im- 
prisonment or death, peopleleam 
the value of remaining silent. 

It is essential, Sullivan adds, 
to break through such cultural 
differences and to teach em- 
ployees to zsk questions and to 
thinkcritically. That is especially 
Important among the ESL 
workers who come from cul- 
tures where speaking out was 



changed in re- 
cent years. And 
in some compa- 
nies, workers 
are now ex- 
pected to par- 
ticipate in 
workgroups, to 
communicate 
with workers in 
different jobs, 
and to solve 
problems that previously were 
the responsibility of supervisors. 

Even that is only part of the 
challenge in addressing ESL in 
the workplace. *'The biggest part 
of the problem for us is the range 
of workers* educational back- 
grounds,** Sullivan notes. ''We 
have people with doctorates in 
their own language and we have 
those who are illiterate in their 
own language."* Difficuldesarise 
in determining how best to as- 
sess such workers as well as de- 
termining how best to address 
their educational needs. 

Workers, employers, and ESL 
instructors must not confuse the 
ESL skills taughton the job with 
the more intensive programs of- 



fered by community colleges. 
For example, a community col- 
lege ESL program involves 16 
hours a week of classroom work 
for an indefinite period of dme. 
By contrast, ESL at the woric- 
place may involve diree hours a 
week for up to 10 weeks. 

That brings up what Sullivan 
calls die "classic difference be- 
tween education and training. 
Education is long term and takes 
in die whole person,** she says. 
"Training is basically short term 
and focused on a specific goal. 
The motivation is there. People 
know that die more training they 
get, die more promotable they 
become. But you can^t promote 
everybody on die assembly I ine. 
There are only so many jobs 
available to move up to."* 

While some companies are 
dedicated to changes in the 
workplace, others are lagging 
behind. Corporate attitudes 
about worker training must shift 
along with changes in the 
workplace, Sullivan says. 

In the future, she adds, indus- 
tries could pool their resources 
to provide training for immigrant 
workers* That way, workplace 
training could be available to 
workers diroughout the state. 

For example, if nurseries in 
the state each contibuted $1,000 
to the nursery association for 
worker training, an ESL curncu- 
lunri could be established and 
training provided to nursery 
workers on a statewide basis. 

Such widespread training, 
which also is needed in die elec- 
tronics and other industries, 
could address cultural aspects of 
die jobi social issues, and odier 
changes that immigrant workers 
face, Sullivan notes. 



ESL programs ticncfic ial to both employees and employers. See inside pa^cs. 
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ESL training helps 
worlcers develop job, 
social skills 



by Sharon DeBusk 



It*s Tuesday aftemoon at Leupold and 
Stevens, and (he wheels of production are turning 
as workers from around the globe assemble the 
componenlsofsports optics equipment. For 85 
years, the Beaveiton company has churned out 
binoculars, sporting scopes, and telescopes for 
rifles, and hydrological measurement equip- 
ment 

Buton this weekday aftcmoon,sixemployees 
are gathered in a company conference room for 
a different task — t^iey're tinkering with the 
English language. The mood is upbeat as the 
employees ~ natives of Cambodia, Vietnam, 
Mexico, and the Philippines — gather in the 
room for an ESL (English as a Second Lan- 
guage) class held twice a week at the workplace. 

Instructor Megan Esler, a part«time teacher 
at Portland Community College and an ESL 
specialist, chats with one student about her 
favorite foods — shrimp and crab. One student 
boasts that he has eaten rattlesnake. Another 
student breezes into the room, eager to share 
snapshots from his recent uip home to Mexico. 

For the next 90 minutes, the group reads 
stories from a newspaper together. Esler helps 
them separate the main idea from the details of 
each story. They discuss the meaning of "guess" 
and "estimate." "withstand" and "risk." They 
talk about "the poverty line" and the different 
meanings of the word "crude." They focus on 
idioms, such as "making a motmlain out of a 
molehill." 

TTie class is part of Leupold & Stevens' 
participation in the Columbia-Willamette Skill 
Builders Consortium. ESL classes also have 
been offered at LWO Corp., a small wood- 
products manufacturing company in Portland. 

At Leupold & Stevens, company managers 
recognized that many workers needed to 
strengthen theif reading, writing, and other ba- 
sic skills. While the company has "quite an 
ethnic mix of employees," says Jim Gilles, 
manager of human resources, the need to enhance 
workplace skills extended to other workers in 
the company'sworkforce, which reaches500 In 
peak summer months. 

Many employees could sit at their worksta- 
tion and assemble a product, but they couldn't 
read or fill outapcrformancecvaluaiion, Gilles 
notes. Language barriers prevented some em- 
ployees from asking for clarification, reporting 
problems on the job, or making suggestions for 
improvement 

Ncwsophisticatcd machine toolsand rapidly 

o 
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changing technology are making it more impor- 
tantlhanevertohaveskilledcmployces. "We're 
going to have to train our people to do the jobs 
here, and one of the basic i.ssues is getting them 
to the level where they are trainable," Gilles 
says. 

The first eight-week session was designed 

and taught last fall 
by PCC instructors 
Linda Clarke and 
D'AnneBurwell. In 
that session, lessons 
were based on the 
needs of the work* 
place and the lan« 
guage skills needed 
to perform specific 
jobs. However, in- 
structors found that 
employees were 
well equipped to 
perform their jobs, 
but hungry for lan- 
guage skills that 
would help them 
communicate better 
with their co-work- 
ers. The ESL em- 
ployees, Esler 

notes, fell a need to ^san Esler and students 
leam English for reasons other than job perfor- 
mance. "They told me they didn't want to feel 
'stupid' on the assembly line with their friends, * 
Esler recalls. "I'm teaching what I call cultural 
literacy." 

Esler works on critical lliinking exercises 
and teaches some technical English. "I try to 
leach some formal words they might run across 
in manuals, so if they run across the word 
^excessive' they know it means 'extra.'" 

The class also reads the company newsletter, 
which has given workers insight into how the 
company operatas. The group is working on 
writing a letter about their ESL class to submit 
to the newsletter, Esler says. Students also are 
teaming how to fill out performance evalua- 
tions in the class. 

Esler says students in her class are gaining 
confidence. ''We're working on group p o- 
cess," she says. 'They're teaming how to speak 
up in meetings." Such skills may help employ- 
ees who are reluctant to inform supervisors of 
problems or to offer suggestions because of 
language barriers or cultural differences. 



While the program has provided a learning 
experience for students, the instructors and the 
company have benefited, too. 

For example, classes initially were offered 
only after work hours, and attendance suffered 
as a result. To address that concern, the eight* 
week session that started in May was split, with 
half of it conducted on company time and half 
on worker time. 

"It was a way of answering those concerns," 
Esler notes. "For the worlcers, it says they cared 
enough to stay after, and (or the company, it 
says it cared enough to give workers release 
time/* Leupold & Stevens also offered two 
quarters of math taught by MHCC instructor 
Maiigie Taylor 




In an ESL class at Leupold & Stevens 

Like Leupold & Stevens, LWO Corp. (for- 
meriy Lattice Works of Oregon) was concerned 
about communication problems at its manufac- 
turing plant. About iialf of the company's 100- 
125 employees are Hispanic and another third 
arc Southeast Asian. Language barriers arc 
heightened by a noisy environment in which 
workers wear face masks and earplugs. 

Ann Schneider, a part-time instructor at PCC 
and a trainer and marketer for a welfans reform 
project at MHCC, was a major force behind 
LWO's workplace English program. After 
joining the project in June 1990, she assessed 
the language skills of about 45 workers and 
interviewed company managers. 

In an effort to meet the goals of the Skill 
Builders grant, the program was geared to help 
workers in specific job-related tasks such as 
following and giving directions, giving feed- 
back, and reporting problems. Those areas 
were chosen because they were common to a 
wide variety of workers — department heads, 
lead and production workers, forklift operators, 
and others who would be taking the classes. 



But other needs began to suifacc. *Thc 
feedback wa^, 1 know my job/" Schneider 
says. "They wanted to work on pronunciation 
and grammar and write more narratives. They 
wanted to be able to write letters to friends, 
things like that." 

Richard Campbell, who laught English at 
LWO with Schneider, agrees. **It became ob- 
vious that employees were interested in a more 
general approach," says Campbell, a part-time 
instructor at PCC and fulUtime coordinator of 
the MHCC refugee ESL program. 

**We began to change the focus from real 
speciHc language they would use at Lattice to 
more what they would use everyday in basic 
conversation," Campbell says. "At breaktime, 
you wouldn't want to talk about Lattice. You 
might want to talk about the Trail Blazers." 

Beginning and intermediatelevelESLclasses 
were held for day and swing shifts. Forty to 50 
workers were served throughout the year, but 
instructors and the company sought increased 
attendance. 

In addition, the company identifled more 
specific needs. Forexample, managers became 
concerned about waste on the job when they 
discovered that many employees could not cor* 
rcctly use a tape measure. 'They couldn't break 
down an inch into a half, a quarter, and a 
sixteenth," Campbell says. 

As a result, the program may move into a 
new phase. Campbell and fellow insuiictor 
Margie Taylor will look into designing a three* 
to six*hour training segment that can be taught 
in-house on company time. The training will 
include some English and basic math skills that 
new employees could preview upon being hired. 

Schneider says the new approach would be 
more effective, pani y because it would be offered 
on company lime. "When a utiining is looking 
at work performance, it should be on company 
time — or at least half and half," she says. 

If she had to do the program again, Schneider 
says she would establish a formal process to 
learn what workers want before she established 
a curriculum. "I talked to all the managers, but 
there needs to be a way to get to know the needs 
of the workers so they'll be more invested." 
Schneider later found that interviews conducted 
in workers' native language were most useful 
for understanding their perspectives on the pur- 
pose and focus of the training. 

Schneider commended LWO for its coop- 
eration. "The staff was very willing to work 
with me all along the way," she says. 

Steve Cameron, quality assurance manager 
for LWO, says not all employees see the ben- 
efits of learning workplace English. "It's dif- 
ficult forpeople who put in eight hours of rather 
physical work to understand how English would 
help in such a noisy environment," he says. 

"It doesn't work for everybody,** he adds. 
••But it was a marvelous opportunity for many." 



ESL instructors 
bring range 
of experiences 
to program 

When Megan Ester was growing up in 
Western Pennsylvania, Thanksgiving and 
Christmas dinners in hor home were always 
shared by guests from other countries. 

For Ann Schneider, a fascination with 
helping migrant workers and refugees learn to 
work and survive in our culture began in the 
1970s. 

And Richard Campbell has been working 
with refugees and migrant workers for more 
than a decade. 

The three have brought worlds of experi- 
ence to companies involved in the Columbia- 
Willamette Skill Builders Consortium. 

Ester credits her mother for helping her 
fomi a multicultural, global approach to the 
world. "My mother was involved with a 
United Natk>ns association," she recalls, "and 

she always had 
people over at the 
house. They 
would give me 
dolls — I still have 
this foreign doll 
coltection." 

Esler has 
translated an early 

«^»"^-' irJM 

into a career and a way of life. In 1977, she 
begai: teaching ESL through the Adult Basic 
Education (ABE) department at Portland 
Community College. The ABE programs 
provide schooling for American students up to 
the 1 2ih grade and can lead to GED certifica- 
tion. Ester also worked for PCC's Refugee 
ESL Project, where she helped develop jobs 
through the college's Refugee Employment 
Project. She returned to the ABE Department 
in 1983, where she continues to work today. 

Esler has had many opportunities to teach 
higher-level English, butprefeis to teach th(»e 
with a more critical neeid. "I always come 
back to the real adult world whme people are • 
trying to raise a family, get a job, and survive 
in our culture," she says. 

Hiat's why the opportunity to teach at 
Leupold & StevensaspartoftheSkill Builders 
Consortium appealed to her. "I enjoy woric- 
ing-class people who are dealing with an im- 
mediate need," she says. 
Schneider, who spearheaded the English 




program at LWO, ciimhtly works full time at 
MtHoodCoihmiiniiy College asatrainer and 
mariceter for Slepj Id Suiceess, a wel£lM re- 
fornri project for cltents with limited English- 
speaking skiUs. Since 1978, Schneider has 
been involved lit prfr«mploymentprograms, 
preparingpeopte with limiiedBngllsh skills to 
go to work. Apait-timePCCinstftk^tQr.she 
has taught ESL at sevehil other community 
colteges. Shealsbwork^ittPCC'iRefiigee 
Emptoyment Project tnd the' IhterMitional 
Refugee Centef of Oregon. ' '■. 

**! have had an iitteieit iihcd the '70s in 
working with cli* 
entswhoarehii^ 
grant woriceis or 
refugees,** sht 
says. 'They not. 
only need En* 
glish skills, but 
they need to un- 
derstand our cul* 
ture. It'safasci* 

nadngintetplay.** AnnSehn«kler 

Campbell, coordinator of MHCC*s refli- 
gee ESL program and a part-time PCC in- 
structor, has taught in the adult education 
refugee program since 1979. "Theprogram is 
designed to help refugees get on their feet — 
to give them enough English so they can go 
out and get a job,** he says. ' 

At LWO, Campbell taught ESL with 
Schneider and PCC instructor Sally Huntley. 
Campbell says thatEnglishneeds to be learned 
in an environment that provides ongoing rein- 
forcement He questkms whether shott-term 
woricplace programs are practical for teach- 
ing the language. > 

"It's a lifelong teaming thing versus an 
immediate company need," he says. Com- 
panies may need to offer English programs on 
an ongoing basis if thdy waht to see real 
improvement in workers' communication 
skills. And, he adds, community colleges are 
better suited to teach ESL. 

Esler, though, says students benefit from 
woricplace English program! "We'r6 taking 
English classed to peopte who can't get to 
class," she says. Community colte^ run 
into the same time consid^aatkMiS that com* 
pany ESL progrtos'encouhter-.when tm-. 
payees are expected tb= attend 'them after 
woric. "Thesepeo{)leare|^g(obedat8:30 
to get up by 5:30 to go to Wflit«** Bslef says. 

And,sh6adds.thefiSLelissi9aiteupold 
St Stevens ire motdtiiifkplaee oriented than 
classes-taught iti (<6mjiiunlty.eolIeges» ."At 
school, we touch ofi housing, bMldflg, shop* 
ping, employment, and bMhh,!* ^ says. 
"Here, the basie fhune 6f refiereikie we kept 
coming back to was the ^i^oritplace." 



Additional resources 



Several clearinghouses can provide brief state-of«the«art papers 
and mini-bibliographies on the issues of literacy training for 
limitcd-English-proncient (LEP) adults and teaching English as 
a Second Language (ESL) in the workplace. Among them arc: 

National Clearinghouse on Literacy Education (NCLE) 
Center for Applied Linguistics 
1118 22nd SL.NW 
Washington, DC 20037 
(202)429-9292 FAX (202) 659-5641 

ERIC Clearinghouse on Languages and Linguistics 
(see Center for Applied Linguistics, above) 

ERIC Clearinghouse 

on Adult, Career, and Vocational Education 
Center on Education and Training for Employment 
The Ohio State University 
1900 Kenny Road 
Columbus, OH 43210-1090 

(614)292-4353 or (800)848-4815 FAX (614) 292-1260 
Examples include: 

Fellars, Allyson. Minibib: Workplace Literacy, National 
Clearinghouse on Literacy Education (NCLE), Adjunct ERIC 
Clearinghouse, Center for Applied Linguistics, Washington, 
DC,June 1990, 2p. Provides annotated list of workplace literacy 



and ESL training reports and manuals available through ERIC. 
Available free Grom NCLE. 

Buchanan, Keith. Vocational English-as-a-Second-Language 
Programs, ERIC Digest, ERIC Clearinghouse on Languages and 
Linguistics. Washington, DC, June 1990, 3 p. (ERIC «ED 321 
551). Provides a quick overview of different approaches to 
vocational English-as-a-Second Language teaching: (1) the ESL 
approach; (2) the vocational approach; (3) the work experience 
approach; (4) the workplace approach; and (5) the bilingual 
vocational training model. Available free from the ERIC Clear- 
inghouse on Languages and Linguistics. 

Lopez- Valadez, Jeanne, Ed. Immigrant Workers and the Ameri- 
can Workplace: The Role of Vocational Education, Infomiation 
Series No. 302, ERIC Clearinghouse on Adult, Career, and Vo- 
cational Education, Columbus, OH, 1985, 56 p. (ERIC #ED 260 
304). Presents issues and strategies used to prepare limited- 
English-proficient adults for employment Discusses different 
types ofES L teaching and a model for vocational ESL; di fferences 
in cultural values and adjustment and the need for cross-cultural 
training; approaches for diverse training needs of LEP adults; and 
employment services for these adults. Available from the Clear- 
inghouse on Adult, Career, and Vocational Education. 

To obtain publications listed in the Educational Resources Infor- 
mation Center (ERIC), call l-800.USE-ERICor 1-800-873-3742. 
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Skill Builders Consortium serves nearly 900 

Partners cite successes and lessons learned 



I felt involved in being ^world 
class. ^ 

— Warn Industries employee 

Being ' 'world class" is what 
lt*s all about. Sinceyou read the 
first issue of Skill Builders in 
January 1991. the Columbia- 
Willamette Skill Builders Con- 
sortium has continued to help 
workers and employers achieve 
their goals. Eight companies 
and more than 848 workers have 
participated in the consortium's 
classes and tutorial labs. 

The 18 labor, industry, and 
education partners collaborated 
to provide workplace-based in* 
struction in basic math and 
measurement (shop math), basic 
writing, computer basics, com- 
mercial drivers license test 
preparation, English in the 
workplace, and individual skills 
enhancement. 

The consortium was formed 
in early 1988 in response to a 
growing awareness of the need 
for improved workplace literacy 
training and coordinated service 
delivery in Northwest Oregon. 
In 1990, iJic U.S. Department of 
Education awarded a $399,000 
grant that was matched by 
$227,000 of in-kind conUibu- 
tions from the partners. The 
money laid the framework for 
the consortium to work toward 
two major goals: 

(1) To help workers become 
lifelong learners who will con- 
tinue to upgrade their skills and 
maintain their competitive, pro- 
ductivccapacityastheirjobskills 
requirements change, and 

(2) To demonsu-ate and dis- 
seminate a workplace literacy 
consortium model that builds the 
capacity of educational provid- 
ers and bus incsses, indusu-iesand 
labor organizations to provide 



cost-effective workplace literacy 
training. 

The consortium has far sur- 
passed its original goal of serv- 
ing 300 workers. As we near the 
end of the grant, nearly three 
times that number have partici- 
patcdtoupgradetheirskills. The 
Skill Builders insU'uctors com- 
mitted long hours to learning 
about the various work.siies and 
designingtrainingappropriateto 
workers* and employers' needs. 
Their dedication paid off. 

*'Ipcrsonallytookmostofthe 
classes,'* notes Phyllis Groclle, 



^What the grant has dona for us 
Is abova and bayond what wa 
would hava had tha rasourcas 
toprovlda: a knowladgaabia, 
rasponslva In-housa Instructor 
who could also wear tha hat of 
program davelopar ... * 

-^ToniMcConnell 



last, ril study more and I know 
ni pass it;* 

Managers, too, were im- 
pressed by their involvement in 
the consortium. "Due to the 
overwhelming acceptance and 
success of the previous progr im , 
we are proposing adding the fol- 
lowing crafts — roofer, floor 
covercrs and painters (tapers)," 
says Garry P. Goodwin, director 
of instruction, Oregon-V'ash- 
ington Carpenters-Employers 
Apprendceship&TrainingTnist 
Fund. 

ToniMcConnell,trainingand 
development 



director at Warn 
Industries, says 
the consortium 
helped her com- 
pany focus on its 
workplace 
needs. "What 
the grant has 
done for us is 
above and be- 
yond what we 

an employee at consortium part- would have had the resources to 
ner Lcupold & Stevens. "Math provide: a knowledgeable, re- 
wasnotoneofmybettersubjccte, sponsivein-houseinsmictorwho 
cither. The review of fractions could also wear the hat of pro- 
and decimals was very helpful, gram developer and produce rel- 
We even worked in areas where evant Warn materials ... I com- 



I had never ventured before, and 
it was fun and an interesting 
challenge." 

Adds Mike Bowman, who 
studied for his commercial driv- 



mend you for your foresight in 
requiring participants to pay part 
of the tab for such training and 
education. I think it makes com- 
panies clarify what they want to 



ers license through a consortium accomplish and accept owner^ 

partnership, 'This program gave ship of accountability." 
me confidence ... to pass the At Nabisco, Clark Nelson, 

general knowledge test. From personnel manager, said his 

there I went on to pass the rest of employer has pledged to con- 

theothersixtests...Withoutihis tinue its efforts at upgrading 



program and the sincere help 
andinsuiiction...Iwouldn'thave 
known where to begin. The 
manual seemed so big and hard 
at first. ... Hazardous materials is 



workplace basic skills. "We are 
... committed to conuributing to 
the consortium's services by 
paying forinsinictorlime inclass 
as well as reimbursing our em- 



ployees for their time as partici- 
pants. This reflects the high level 
of our satisfaction with the Skill 
Builders program." 

In addition to the skills, 
knowledge, and confidence pro- 
vided to workers in the North- 
west, the partners of this work- 
place skill-building consortium 
have also learned a great deal. 
Our "lessons learned" are em- 
bodied in the following recom- 
mendations for effective work- 
place training programs: 

• Expand your vision of 
workplace literacy training to be 
a process of organizational and 
human resource development. 

• Give high priority and suf- 
ficient resources to the careful 
design and development of 
quality curricula that address 
changing needs fbr new skills 
and encourage workers to be- 
come lifelong learners. 

• Make the program worker- 
centered by building in a com- 
prehensive worker involvement 
component that includes work- 
ers from all levels in all phasesof 
the program (from needs as- 
sessment through u-aining de- 
sign, delivery and evaluation). 

• Provide release time or other 
forms of employee compensa- 
tion for hours in training. 

• Design the evaluation to 
include context-appropriate 
evaluations of learner skill ac- 
quisition and job outcomes, 
buildingon company and worker 
criteria for improvement. 

Despite gloomy economic 
forecasts, changing workplace 
technology, and a barrage of 
criticism aimed at the American 
worker, recent studies show that 
only one of 12 frontline workers 
receives any formal training on 
Continued on back page 
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Warn Industries: 
On the cutting 
edge of changes 

in the workplace 



T 



Release time, 
pay for knowledge 
enhance worker 
training at 
forward-looking firm 



Stories by Sharon DeBusk 



o the casual observer, Warn Induslrics in Milwautde looks 
like a standard factory, with lis maze of machinery and 
slacks of shiny parts. 

On the shop floor, woilcers in safety glasses manufacture 
and assemble the products Warn is known for — 4-whecl 
drive hubs, winches, and light truck accessories. Workers 
are familiar with the language of off-road travel. 

But upstairs in a small classroom, away from the din of the factory, 
a small group of employees is learning a new language — the lan- 
guage of computers. The class is part of Wam*s participation in the 
Columbia-Willamette Skill Builders Consortium. Basic math also is 
being taught as part of the program. 

Scott Copcland, workplace literacy instructor through Clackamas 
Community College, tells his computer students to type the following 
paragraph: **No matter what job you have, computers are headed your 
way. To save time and reduce errors, computers will be used exten- 
sively in the manufacturing cnvironmenL" 

The paragraph is only a keyboard exercise, but it points to the 
major changes underway at Warn Industries. 

Two year ago. Warn realized that the company would have to 
change its way of doing business if it was to survive the competitive 
international market, according to Toni McConnell, training and 
development director for Wam, which employs about 440. 

The company began taking measures to streamline manufacturing, 
improve quality and involve employees, In July 1990, Wam elimi- 
nated two layers of management and has since been converting to 
"product focus teams.'* 

Previously, the company was divided into departments, such as 
manufacturing, assembly, planning, purchasing, Tinance and adminis- 
tration. Now, IS product focus teams operate like mini-businesses 
within the plant. Each handles its own ordering, purchasing, engineer- 
ing, manufacturing, assembly and .shipping, "It's an all-out attack on 
waste," explained McConnell. 

The changes have had a dramatic impact on workers. 
For example, a machinist "will have to solve problems and 
communicate, may talk with customers, may do assembly work or 
computer work," McConnell said. "Whatever it lakes to gel the job 
done, you must now be trained and willing to do." 

Company leaders knew they would need a highly educated, skilled 
and flexible workforce to carry off their plan. But before workers 
could be trained in new jobs, they needed to brush up on basic skills. 

To address needs, Wam began to offer basic math, blueprint 
reading and communication classes. In the meantime, the Skill 
Builders Con*' )rijum was formed, and Clackamas Community College 
began working with Warn Industries and Oregon Cutting Systems, 
another Milwaukee firm involved in the consortium, Copeland was 
hired to teach at both businesses. 

At Wam, Copeland interviewed employees and supervisors to 
determine what kind of classes they needed. While math classes had 
been offered, employees said the material wasn*t relevant to their jobs, 

"Instead of just teaching addition, subtraction and percentages, he 
took all the generic qucsl^ions and put them in Wam language," 
McConnell said. "He made it relevant to what they do." 

For example, Copeland teaches the math skills necessary to figure 
out how many hubs will fit into a certain .sized shipping box. In 
another exercise, a worker might be asked to build racks on a wall in a 
workstation. Copeland teaches the employee »-ow to use fractions and 
decimals to figure out the coned dimensions. 

Copeland said he served about 100 students since the beginning of 
the year in three quarters of math classes. 
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The computer cinsscs were even more popular. Copcland, who 
wrote a computer handbook especially for Warn, is in his fourtli 
cight-weck teaching cycle. He estimated he has served 134 computer 
students. 

Two factors have made ihe gram project particularly successful at 
Warn, Copeland said. First, all required classes are offered on paid 
time. ''When people aren't paid to be there, or if they're paid pan 
time, that hurts aitendancc." Copcland said. "People have oilier 
priorities - kids to pick up, spouses lo share nights with. It's not that 
they don't want to leain " 

Another factor is that the classes Copeland teaches count toward a 
program at Warn called "Pay for Knowledge." 

Pay for Knowledge is a compensation system that bases wages and 
^ salaries on knowledge and skills rather than the position or job 
* performed. At Warn, pay increases are tied to the number of different 
jobs an employee can perform. 

Workers gain knowledge by Liking cla.sses and/or testing out in 
various ''skill blocks." The company also offers classes in statistics, 
basic machines, measuring instruments and precision tools. 

"It allows the employee to have more conu^ol over salary." 
McConncll said. "You walk up the skill blocks to get knowledge you 
need to m ake the wage you want'* 

ike Warn Indusu-ics, Oregon Cutting Systems has been 
concerned about basic skills in the workplace. Formerly 
known as Omark Industries, the firm makes various 
cutting systems for commercial and agricultural uses as 
well as consumer products such as pruning saws and hedge 
trimmer blades. 
And like Warn, work teams are becoming prominent at 
Oregon Cutting Systems. "In the past, some people punched parts 
and others sharpened them, assembled, packaged and shipped them," 
explained Gale Long, training maniger for Oregon Cutting Systems, 
a subsidiary of the international construction company, Blount Inc. 
"Now it's a team doing all those things for a specific type of prod- 
uct." he added. "So all of a sudden we need a much wider skill set" 
When Oregon Cutting Systems signed on with the Skill Builders 
Consortium, the company had already identified literacy as an issue it 
wanted lo address. But when Clackamas Community College 
surveyed employees, it was computer knowledge, not reading, tlial 
emerged as the area most needing attention. 

Copeland off H several sections of computer classes and worked 
with a few indiviJuals on math. However, the company has not 
offered the grant-sponsored classes on paid time 

"As an organization we haven't been able to justify paying 
people," said Long. "We still believe it's a mutual challenge between 
employer and employee. We're going to make it available, but they 
have to have some ownership, too." 

Helen Humphreys, basic skills instructor and Skill Builders 
coordinator ai Clackamas Community College's Targeted Learning 
Center, said the compensation issue is imporuint. "Companies either 
need to pay for some percentage of classes or there needs to be a clear 
line of advancement after learning the skills," she said. "Adult 
Icamers need to know where they are going with a class." 

Confidentiality also is an important issue for employers to 
consider when establishing basic skills workplace training programs. 
"Companies have to assure workers that what we learn about ihcm 
won't be used against them in the workplace," Humphreys said. 

At both Warn and Oregon Culling Systems, employees concerned 
with privacy can attend classes at the Targeted Learning Center, 
which is located near the companies. 



From dockworker 
to literacy instructor, 
Copeland brings 
variety to workplace 

Scott Copcland has been a dockworker, a restaurant manager, a 
hardware and paint salesman, and a jobanalysis specialist. And he's 
taught psychology and statistics at ihc college level. "I have a lot of 
real-world experience," he says. 

These days, Copcland goes by the title "workplace literacy 
instructor," and he offers his skills teaching math and computers to 
employees at Warn Industries and Oregon Cutting Systems, two 
Milwaukic firms involved iniheColumbia- Willamette Skill Builders 
Consortium. (Warn Industries recently 
hired Copcland as full-time training 
coordinator). 

Those backgrounds in both the 
profcs.sional and blue-collar worlds 
may explain why Copcland is highly 
regarded by as.^ociatcs and students 
alike. His quiet wny can be deceiving, 
though. "He's really soft spoken and 
low key," says Helen Humphreys, in- 
structor and Skill Builders coordinator 
at Clackamas Community College's 
Targeted Learning Center. In fact, 
when Clackamas first hired Copeland as a tiainer in the Skill 
Builders project, Humphreys had reservations. "He's so low-keyed 
that at first I was a little concerned about whether he could do the 
job,"shc.say.s. "Well, it turns out he can do it!" Humphreys recalled 
that Copcland wasted no time getting to know people at Warn 
IndusO-ies. "He was making himself at home without getting into 
anyone's way - making himself a part of that riilture." 

Toni McConncll, training and dcvelq)ment director for V/am 
ndnsfrics, agrees. "I can't say enough nice things about Scott. He 
wrs able to dig in without much direction or supervision. He's the 
kind of guy you would invite to a big famMy shindig because he 
would do whatever needed to be done." 

The soft-spoken Copeland admite that he relates well to workers, 
"I know what work is like as oppo.scd to someone who is com ing out 
of education. Tliey have su-engths, too, but they have lo realize that 
lhe.se people don't think of themselves as students. They think of 
them.selves as workers." 

Copcland has long been interested in workplace literacy. Last 
^car, he completed a master's degree at the University of Arkansas/ 
.iiile Rock in applied indusuial psychology with an emphasis on 
training and learning. He worked as a training specialist at Little 

?ock Municipal Watcrworksandlalcrputtogciherareadingprogram 
•"or Uiick li. '. /ers, 

Copcland has .strong beliefs about helping today's workforce 
>ccome more skilled. "It's notjusta nice thing to do," he says. "It 
las to be done in order to be more flexible. If we don't do this 
training, our jobs will go overseas." 

And if you haven't noticed it already, Copcland enjoys working 
in the manufacturing field. "I like the working class, the blue-collar 
workers," he says. 'Thcy'reopcn. They don't pull any punches, and 
they're not out to .show you they've got all the answers." 
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Consortium partners praise 18-month project 



From page 1 

ihc job. The Coliiinbia-Williamcltc vSkill Builders Consortium 
oblaincd ibc comniilmcnt of business partners to provide part of 
the cash supi)ort for ongoing training development and insuuc- 
lion. Unfortunately, the consortium's application for a second 
National Workplace Literacy grant was declared ineligible due to 
a technicality. Therefore, this issue of Skill Builders is our last 
until further funding is obtained. 

However, consortium partners remain committed to the pro- 
vision of effective workplace training. If you are interested in 
providing appropriate training in yourworksile, you may receive 
more information about services available by contacting; 

Adult Basic Education Department 

Portland Community College 

(503) 777-6911 

Karen Stone 

Director of Employee and Management Development 
Clackamas Community College 
(503) 657-8400, ext. 3523 
Michael Dillon 

Director of Community and Economic Development 
Ml Hood Community College 
(503) 667-7225 
Stephen Reder, Director 

Literacy, Language and Communication Program 
NorlJuvesi Regional Educational Laboratory 
(503) 275-9591 



Skill Builders Consortium 
includes diverse partners 
united to improve skills 

Consortium members include: Anodizing, Inc.; 
Associated General Contractors of America, Inc., Oregon^ 
Columbia Chapter; Cackamas Community College; : ; 
International Brotherhood of Teamsters, Chauffetirs, - 
Warehousemen & Helpers of America, Union Locals 162 and 
206; Joint Council of Teamsters No, 37; Leupold & Slfcveni, 
Inc.; LWO Corp.; Mt Hood Community College; Nabisco, 
Inc.; Northwest Oregon Labor Council, AFL-CIO; Northwest 
Regional Educational Laboratory; Oregon Cutting Systems; 
Oregon Office of Community College Services; Oregon 
Trucking Associations, Inc.; Oregon-Washington Carpenters/ 
Employers Apprenticeship and Training Trust; Portland 
Community College; United Brotherhood of Carpenters & 
Joiners of America, Local Union No, 247; and Warn 
Industries, Inc, 
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Stephen Reder, Project Coordinator 
Tony KnekJek, Editor 

For information about the Consortium, contact: Stephen Reder. Director, Literacy. Language and Communication Program 
Northwest Regional Educational Laboratory, 101 S.W. Main Street, Suite 500 
Portland, Oregon 97204 (503) 275-9591 
The Consortium is an 1 8 -month demonstration project funded by « $399,000 U.S. Dcptrtmenlof Educttion Grant (No. V198A00158)to Portland Community College 
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Basic Skills for Business and Industry 



April 6, 1991 

Dr. Stephen Reder / 
Karen Wikelund 

Northwest Regional Education Laboratory 
101 SW Main, Suite 500 
Portland. OR 97204 

Dear Steve and Karen: 

Enclosed please find the Final Evaluation Report for the Columbia- 
Willamette Skill Builders Consortium U.S. Department of Education 
Workplace Literacy Project. As you probably already know, the project 
achieved-- and even exceeded-- many of its stated goals, the most 
significant of which was probably the sharing of resources among the 
three community colleges in the consortium. And, of course, the 
strongest evidence of success in any of these projects is when the 
business/labor partners continue programs beyond the grant period. 
You can all be proud of the foundation you have built for workplace 
literacy with these organizations. 

I've enjoyed having the opportunity to work with both of you on this 
project and hope that Performance Plus Leamiifg Consultants can be of 
service to you again in the future. 

Sincerely, 




Oorie W. Philippi, 
Executive Director 



7869 Godolphin Drive • Springfield, VA 22153 ♦ 703-455-1735 
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Introduction 

Background : The Columbia- Willamette Skill Builders Consortium for Workplace Literacy 
Programs in the Portland, Oregon area was developed in conjunction with staff members 
from Portland, Mt. Hood, and Clackamas Community Colleges, along with Northwest 
Regional Education Laboratory and the Oregon Office of Community College Services, 
primarily through funding provided by an 18-mondi grant award from the U.S. Department 
of Education. The program was granted a 3-month no-cost extension and operated as a 
national workplace literacy project demonstration from June 1, 1990 through February 29, 
1992 to determine the effectiveness of the Consortium's proposed workplace applications of 
basic skills training model. 

The need for this project grew from a recognition by local businesses and industries 
that the pressures of competition in a global marketplace have accelerated the pace of change 
in workplace environments. The expanding and shifting responsibilities of r-anufacturers 
and businesses in transition from Taylorism to a Total Quality Management system via self- 
directed cross-functional work teams, increasing technological demands and reduced 
production cycle times, along with the advent of national testing requirements for operators 
and drivers, have created an interest among employers and workers alike to enhance use of 
the workplace basic skills needed by the Portland area labor force to meet these challenges. 
Because technical training-specific courses and traditional education often do not give 
workers a broad-based knowledge of team communication, problem-solving, critical 
thinking and leaming-how-to-leam concepts and competencies, participating companies and 
labor organizations determined the need for instructional programs that would provide 
workers with workplace basic skills applications tiiat are transferable and adaptable to tiieir 
chaiiging work environments. 

Area compimies and labor organizations began discussions witii tiie Consortium 
community colleges midway tiirough 1988 to foster the sharing of information and to clearly 
define company/ worker needs and agency responses. This careful exploration of 
possibilities resulted in the partnering to apply for federal grant monies to provide on-site 
programs. Managers and labor leaders representing tiie organizations' training and 
education departments met with the consortium program developers and formed an advisory 
council. It was the responsibility of tiiis council to ensure that Uie customized programs 
directly related to the competencies needed for the workplace and responded to tiie needs of 

Prepared by Performance Plus Learning Consultants, Inc. 
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the targeted worker participants. To this end, the members were committed to gathering 
data for perfonning a "front-end analysis" in order to assess the communication and 
problem-solving needs of targeted worker-participants. They also determined programs' 
goals, lengths, schedules, and implementation plans. 

The developers of the programs, members of the Columbia- Willamette Skill 
Builders Consortium, then custom-designed, created and delivered the instructional 
materials. During development, sharing of concepts and personnel occurred among the 
three community colleges, thus providing amplification of both resources and the program 
review process. A variety of strong programs were subsequently implemented and refined 
during the grant period. Portland Community College, as the grant financial manager, 
contracted with Performance Plus Learning Consultants, Inc. to serve as a third-party 
evaluator throughout the project 

Purpose of the Evaluation : The Columbia-Willamette Skill Builders Consortium has 
requested this third-party evaluation of their U.S. Department of Education Workplace 
Literacy Demonstration Project to assess 1.), tiie extent to which tiie project's goals and 
objectives have been accomplished, and 2.), tiie extent to which program development and 
implementation proceeded as planned. Specifically, tiie evaluation objectives to be 
investigated were: 

• on-going identification of tiie program's strengths and areas still needing 
any improvement throughout tiie life of tiie project; 

• evidence tiiat workplace literacy partnerships were built among business, 
educators, labor, government and community groups; 

• evidence tiiat workplace training developed during tiie project linked basic 
skills instruction directly to tiie literacy requirftnents of actual jobs targeted 
for specialized adult basic education training programs and addressed the 
increasing basic skills requirements of tiie changing workplace; 

• evidence that tiie project programs implemented targeted and delivered 
services to a minimum of 300 workers witii inadequate skills for continued 

Prepared by Performance Plus Learning Consultants, inc. 
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employment, increased productivity or career advancements and offered 
support services to learners that reduced the barriers to participation in 
literacy training; 

• evidence of a smooth instructional flow of activities within the developed 
curricula, reflecting a sound developmental approach to mastering those 
literacy skills necessary for competent performance of identified job tasks; 

• evidence of increased productivity due to improved liter' skills of 
program participants; 

♦ evidence of the development and use of record-keeping and documentation 
systems, including collection, interpretation and reporting of data on 
program development and implementation activities a^ ^ on individual 
progress of participants; and 

♦ evidence of successful program implementation through the use of 
appropriate processes for participant recruitment, class scheduling, 
development of individual education plans, curriculum delivery, pre- and 
post-assessment, and instructor training and support, that are academically 
and organizationally sound and that match with program goals. 

Additionally, recommendations were requested on the issues and concerns about consortium 
model replicability, limited lo data gathered from observations, survey and test results, 
anecdotal records and interview information. 

Description of the Project t o be Evaluated : The Columbia-Willamette SkiU Builders 
Consortium Workplace Literacy Project consisted of eight workplace literacy training 
partnerships formed between three greater Portland area community colleges and 
businesses, industries, and labor organizations, with assistance from Northwest Regional 
Education Laboratory, a not-for-profit educational research organization, and the Office of 
Community College Services. The original demonstration project partnerships were as 
follows: 

Prepared by Performance Plus Learning Consultants, /nc. 
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Clackamas Community College and: 

• Oregon Cutting Systems- manufacturer of cutting edges for industry, 
specifically for the timber industry at this location. 

• Precision Cast Parts Corporation- manufacturer of large cast metal parts for 
aviation industries. 

Mt. Hood Community College and: 

• Associated General Contractors, Inc.; Oregon- Washington 
Carpenters/Employers Apprenticeship and Training Trust; 
United Brotherhood of Carpenters & Joiners Lxx;al 247; 
Northwest Oregon Labor Council AFL-CIO- independent 
building and construction companies plus member labor 
organizations. 

• Oregon Trucking Associations; Fred Meyer, Inc.; Interna- 
tional Brotherhood of Teamsters Local 162; Joint Council 
of Teamsters No. 37; Northwest Oregon Labor Council 
AFL-CIO- independent trucking firms, local retail shipper/ 
receiver, plus member labor organizations. 

• Fred Meyer, Inc.; International Brotherhood of Teamsters 
and Warehousemen Local 206; Joint Council of Teamsters 
37; Northwest Oregon Labor Council AFL-CIO- retail ware- 
houser, plus member labor organizations. 

Portland Community College and: 

• Leupold & Stevens, Inc.- manufacturer of sports optics and 
hydrographic instrumentation 

• LWO Corporation- manufacturer of wood products (lattice) 
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• Nabisco, Inc.- food products manufacturer 

During the course of the demonstration, Fred Meyer, Inc. and Precision Cast Parts 
Corporation terminated their participation due to circumstances external to the project The 
Consortium recruited the replacement partners of Anodizing, Inc., an aluminum extrusion 
manufacturer, and Warn Industries, a winch and hubcap manufacturer. Also, tiie carpentry 
and trucking programs involved insurmountable political problems among cooperating 
partners during early stages of the grant period and subsequently shifted their focus to 
highlight labor- sponsored delivery of services. 

According to the published description of the program, the design of the project was 
structured to meet workers' job-specific basic skills application needs through the 
development of functionally contextual curricula. On-site investigation and job analysis 
conducted by community colleges' staff resulted in the development of an assortment of 
curricula and instructional delivery formats tailored to meet the various employer/worker 
needs of each of tiieir partners. Brief descriptions of each program follow: 

Oregon Cutting Systems: The program began as on-site mini version of die college 
education lab. Targeted Learning Center, offering individualized coursework in 
GED prep, math and reading skills; it expanded to nine-hour topic courses, created 
in response to worker suggestions, that included business writing and business 
English; it evolved into an ongoing, individualized workplace math study group and 
well-attended work-related computer basics aiid keyboarding courses. The math 
gioup utilized two commercial texts, Mathematics for Machine Techntil^ gy (Delmar) 
and Basic Essentials of Mathemarif^sf (Steck- Vaughn), along with a 55-page 
customized Statistical Process Control (SPC) Math curriculum. The computer class 
utiUzcd a customizea 64-page text. Cutting Throug h to Computer Comp etency. The 
company provided a computer lab for course use. Metliods of instruction for both 
courses included one-on-one witii instructors and group discussion, where 
applicable. 

Warn Injiusuies: The program began as an on -site basic matli class; it became a 55- 
page customized SPC course, Warn Shop M;.th. and 33-page customized, work- 
related, project-centered computer basics and keyboarding course, PCs at Warn. 
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Open-exit classes met for 1 hour, twice per week, with most participants finishing 
after 16-20 contact hours. An additional "catch-up" class was also offered to assist 
workers whose job schedules precluded their attending regijlar sessions. 

Oregon- Washin gton Carpenters/Emplovers Apprenticeship and Training Trust: 
United Brotherhood of Carpenters & Joiners Local 247: Northwest Oregon Lab ^r 
Council AFL-CIO : A drop-in learning center was operated on-site to provide support 
in mathematics to apprentices participating in intensive 1-week construction trade 
courses, four times per year, as part of a 6- year work/study program leading to 
journeyman status. Prc-apprentices also were tested and provided with evening one- 
on-one tutorial assistance in math as requested The center operated for two days 
each week, opening for 3-hour periods, with two instructors present. Customized 
mathematics instmctional materials (93 pages of worksheets, handouts, and forms 
plus topic pretests and posttests) were developed for use in conjunction with job 
tasks requiring reading blueprints, calculator use, algebra, geometry, and specific 
measurement conversions. Student attendance at the center was voluntary and 
varied from 1 to 6 hours. 

In gmational Brotherhood of Teamsters Local 162: Joint Council of Teamsters No. 
2lL Northwest Oregon Labo r Council AFL-CIO : A drop-in learning center was 
operated at the Teamsters Meeting Hall to provide study sessions and materials to 
assist union truck drivers with preparing for the Commercial Drivers' License test. 
The center was open for 12 hours each week, operating on varied hours to 
accommodate drivers' schedules. Participation was open-entry, open-exit, with 
attendance prior to passing die test averaging 1 1 hours. Curriculum consisted of 10 
activities, each with instructor directions, handouts, manipulative materials and 
study caids, plus pretests and posttests, to accompany the Oregon Commeix^ial 
Motor Vehicle Operator's Manual. Additionally, audio-visual supplemental 
materials were available for use as needed 

Anijdizing, Inc.: On-site math instruction was provided by 3 instructors in 20-hour 
classes, meeting 1 hour per week during employee lunch breaks, on clock time. The 
course included 54 pages of worksheets, handouts, pretests, posttests and overhead 
trajispai-encies within three units addressing place value, whole number operations, 
measurement, fractions, decimals, percents, and computing tolerances. Several 
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examples of Anodizing, Inc. job materials were integrated into each instructional unit 
to demonstrate the application of math concepts taught to job performance. One-on- 
one and small group instructional techniques were utilized in delivery. 

Leupold & Stevens. Inc. : Two separate segments of instruction were conducted on- 
site. During tlie beginning months of the project an English as a Second Language 
(ESL) program was offered in two 8-week cycles of 1.5 hour classes, 2 times per 
week. Commercial materials. Preparatory Technical Eng lish (Pittman) and News 
for Yo u, along with the Leupold & Stevens monthly newsletter, were used to assist 
participants with ■ ■ f'erstanding and using vocabulary related to work situations and 
current events in order to increase socia^ and cultural comfort within work teams, 
complete vriitten performance reviews, and describe hypothetical problems requiring 
thinking skills. A blueprint math applications course utilizing the vehicle of a 
scientific calculator was developed and provided during the second half of the grant 
period. Math applications addressed included decimals, fractions, measurement, 
averages, ranges, metric conversions, and basic trigonometric functions. Classes of 
2.5 hours duration were offered 2 times each week, for two groups simultaneously, 
each with its own insaiictor, during 4-week cycles of instruction. Materials 
consisted of an eclectic selection of topics and pages f;0m commercially available 
math texts, (sources not identified). Each instructional unit incorporated at least one 
example of a Leupold & Stevens workplace situation or job material that utilized the 
math concepts being taught. 

LWO Corporatiori : Two levels of English for the Workplace classes each were 
conducted for 1.5 hoars, two times each week, using 3 instructors, on a fall and 
spring semester-like schedule of T-week cycles over the period of the grant Classes 
were located in a small house adjacent to the factory. The first level courses focused 
on spoken vocabulary development and utilized a Total Physical Response method 
to address instmctional topics related to work situations requiring following 
directions, clarifying directions, giving directions, giving information to clarify, and 
giving feedback. Job materials, photos, tools, wood products, supplies, etc., were 
integrated into each lesson. Tiie advanced level course concentrated on improving 
reading and writing skills, along with oral language skills. Commercial materials 
us^d included, SoeakinaUp at Work (Oxford American English) and English for the 
Workplace. ESL for Action (Addison- Wesley), as well as "The Key," a page from 
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the Oregonian . Individual interests of participants guided the content of most 
advanced level lessons, with only secondary serendipitous emphasis being placed on 
work-related topics. A Buddy System, pairing non-native speakers with workers 
who were native speakers or more proficient speakers of English was operated 
throughout the period of tlie grant as well. 

Nabisco. Inc. : Support classes in math were integrated into 5-week company 
technical training for converting to computerized equipment installed in several 
departments of the plant. The math component, "Nabisco Math," was delivered 
during 12-15 hours spread throughout one week of the technical instruction. Each 
cycle of training had 8-10 participants. Materials were customized to assist workers 
with newly required job applications of math and study skills presented in the 
training. Three hours were devoted to study skills and information locating skills, 
and an additional three hours were dedicated to learning calculator use skills. 
Following this training, a second segment of instruction continued throughout the 
grant period, "Skills Enhancement Training," an open-entry, open-exit learning 
center designed to assist workers with basic skills brush up in reading and math. 
Instruction was built around leamer-instructor joindy developed Individual 
Education Plans and utilized workplace materials and manuals as well as 
commercially available adult education instructional materials. Customized 
assessment instruments were also developed for several plant departments. Many 
participants worked toward departmental certification with support from the SkiUs 
Enhancement Training. Attendance was as high as two to three h uis jer week for 
periods up to eight months in duration per learner. 



Method 

Design : llie evaluation of the Columbia- Willamette Skill Builders Consortium Workplace 
Literacy Demonstration Project employed a modified version cf the Context-Input-Process- 
Product (C.I.P.P.) model, (Stufflebeam & Cuba, 1971). Thi^ethod of evaluation was 
chosen by the evaluator as the most suitable tool for investigating the evaluation objectives, 
(see pages 4-5), because it examines project effectiveness through structured analysis of the 
cohesiveness of project goals, components, and operations, independent from comparisons 
to outside standards or other programs. 
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The C.I.P.P. model was used to analyze: 

♦ Context (i.e., shared goals and philosophy of key personnel and 
participants); 

♦ Input (i.e., resources, including personnel, materials, time and 
facilities); 

♦ Process (i.e., congruence of obser/ed instructional development and 
delivery with project goals and research on instructional 
effectiveness); and 

♦ Product (i.e., indicators of project effectiveness). 

It is important to note that, due to the large number of partnerships and limited 
resources allocated to evaluation in this project, extensive and uniform investigation at all 
sites was not possible. Forms and procedures for use in data collection across sites were 
developed by PPLC and explained to representatives and staff for each partnership, as well 
as to the project directors from Northwest Regional Education Laboratory; however, despite 
oral and written communication concerning deliverables, some of the data requested was not 
forthcoming. Where requested data was not received, it is so noted throughout the 
remainder of this report. 

Participants : The participants in the project were workers employed by the partner 
companies or members of the partner labor organizations. A brief description of the 
available composite average worker profiles by sites is provided below for reference. 

Oregon Cutting Systems: 

Caucasian female, age 36-50, with high sch(X)l diploma, 
employed by company for more than 10 years (n =66) 

Warn Industries: 

Caucasian male, age 36-50, with high school diploma. 
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employed by company for more than 10 years (n = 210) 

Associated General Contractors; Oregon- Washington Carpenters/Employers 
Apprenticeship and Training Trust; Unite Brotherhood of Carpenters & Joiners 
Local 247; Northwest Oregon Labor Council AFL-CIO: 

Caucasian male, age 30-35, with high school diploma, 

employed full-time (n = 307) 

Oregon Trucking Associations; International Brotherhood of Teamsters Local 162; 
Joint Council of Teamsters No. 137; Northwest Oregon Labor Council AFL-CIO: 

Caucasian male, age 40-45, with high school diploma, 

employed full time (n = 92) 

Anodizing, Inc.: 

Caucasian male, age 30-35, with high school diploma' 
employed full-time (n = 72) 

Leupold & Stevens, Inc.: 

Hispanic male, age 26-35, with high school diploma, 
5 years in present position with company (n = 10)* 

LWO Corporation: 

Hispanic male, age 26-35, 7 yrs. school outside US, 
employed full-time (n_= 48) 

Nabisco, Inc.: 

Caucasian male, age 36-50, with high school diploma, 
more than 10 years in present position v/ith company 
(n = 42)** 

=^ data available from one English as a Second Language class only; for other ESL class, 

n = 13, for math classes, n = 35 
** last data received, November, 1991 
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Because of the nature of the evaluation design, the focus of evaluation activities 
extended beyond the traditionally-held concept of "participants" to also include project 
administrators, the employers, labor organizations, instructors and developers. 

Instruments : Data for this evaluation were requested and gathered via pre- and post- 
program learner surveys, structured interviews with learners and program personnel, 
instructor anecdotal report forms and questionnaires, supervisor ratings, and formally- 
documented observations of instructional sessions and instructor training. (See Appendix A 
for sample forms.) Additionally, data were gathered from detailed analysis by the evaluator 
of program documentation, instractional materials, and learners' work, ( i.e., pre- and 
posttest scores and learners' records). 

Procedure : Following initial telephone conversations with key personnel at Northwest 
Regional Education Laboratory to establish evaluation objectives, the evaluator conducted 
the activities listed below: 

1 . Development of Evaluation Data Collection Instmments : 

• Forms created for Participant Pre- and Post-Program Surveys, 
Instructor Interview, Instructor Anecdotal Records, Learner 
Individual or Focus Group Interview, Classroom Observation, 
Employer/Supervisor Interview and Supervisor Evaluations. 

2 . On-rite consultation with curriculum developers concerning instructional 
curricula design and development and feedback on how to strengthen 
activities contained in them. 

3. On-site interviews with training and production managers, supervisors, 
instructors, project managers and learners from the three community colleges and the 
partnering businesses, industries, and labor groups. 

4. On-site obsers'ations of classes during various cycles of instructii m. 
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5 . Off-site analysis and review of materials and collected data from sites. 

6. Communications and Operations: 

• Contact throughout grant period with project through conversations 

with project director Steve Reder, to discuss project goals, 
progress, and evaluation activities and preliminary findings. 

• Telephone and in-person interviews with each of the three 
community college project coordinators, Helen Humphreys, Nikki 
Sullivan, and Wayne Werbel, October 1991 through March 1992, to 
discuss administrative issues and concerns, evaluation data 
collection, and future plans for the consortium.. 

• Final Evaluation Report submitted to project director at 
Northwest Regional Education Laboratory, March 1992. 



Results 

Project Context : 

To what extent are goals and philosophy of the project shared bv kev 
project personneLand learners ? 

This section of the evaluation is a comparison of the project goals and priorities as 
reported in project descriptions and interviews with key project personnel, including; 

• project director(s) 

• project designers and coordinators; 

• managers, trainers & labor representatives; 

• project instructors; and 

• learners. 

These viewpoints about project goals were analyzed for consensus and divergence. 
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The published project goals and purposes are contained in the grant proposal 
submitted to the U.S. Department of Education. They were developed cooperatively after 
almost one year of meetings and communication between community colleges; Northwest 
Regional Education Laboratory; and partnering businesses, industries and labor 
organizations, prior to applying for the grant monies. Stated goals and objectives in the 
grant proposal included: 

• learner increases in specific job-related skills and in basic math, reading 
and writing, and English language skills; 

learner enhancement of problem-solving skills, promotability, employment 
prospects and increased self-confidence; 

• learner access to vocational and educational counseling services; 

• establishment of ongoing partnerships between industry and education; 

• improved employee performance and productivity on targeted jobs and 
ability to adapt to changing workplaces; 

• provision of tutorial/remedial support for specific job requirements, e.g., 
apprenticeships, certitications, promotions for a population of at least 
300 participants; 

• educator increased knowledge and expertise in the field of workplace 
literacy; 

• educator enhanced knowledge of skills needed by local businesses 
and industries; 

• expanded Adult Basic Education delivery and outreach by community 
colleges; 

• removal of [perceived] barriers to instruction for target groups, e.g., 
cost, relevance, logistics, lack of confidence, childcare, transportation, and 
training materials; 

• establishment of a regional network of workplace literacy experts and 
spokespersons; 

• sharing of resources and expertise among consortium members; 

• development of raetliodology for assessing workplace literacy needs; 

• provision of a network infrastructure for dissemination of project results; 
and 

• launching of a Northwest Workplace Literacy Campaign. 
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Project Director(sV On June 21 and August 1, 1990, and on February 7, 1992 
Stephen Reder, of Northwest Regional Education Laboratoiy, was interviewed about his 
perceptions of program goals and philosophy. Speaking forliimself and NWREL, he 
articulated the following project goals: 

♦ to create a stable entity for providing workplace literacy services in the 
Portland area beyond the period of the grant; 

♦ to provide a comprehensive community college service to those employees 
whose job and residence locations do not match with existing district 
boundaries; and 

♦ to enable the sharing of resources for providing workplace literacy 
programs among the community colleges participating in ttie consortium. 

Project Designers and Coordinators - Helen Humphreys, Nikki Sullivan, and Wayne 
Werbel, Project Coordinators for each of the participating community colleges, along with 
college administrators Diane Connet and Pam -, and curriculum developers Mary Smith, 
Ann Schneider, Linda Clarke, D'Anne Burwell, Don Hartzog, Scott Copeland, Maijorie 
Taylor, and Sandra Clawson, were interviewed during one or more of the three site visits: 
July 31- August 3, 1990, November 5-9, 1990, and January 13-16, 1991. The goals 
expressed centered around activities, planned or in process, for individual worksite 
programs and/or college providers. 

Five of the curriculum developers mentioned building learner self-esteem as a 
primary goal of programs. All curriculum developers noted that developing expertise in the 
techniques required for providing literacy programs for workers was very important to 
them, i.e. conducting needs assessment and literacy lask analyses, creating functionally 
contextual instmctional materials. They also felt that materials developed should be 50-75% 
work-related. The college administrators' goal statements both included frequent references 
to being able to use the grant to expand adult basic education programs and technologies 
ahtiady existing within the colleges' academic programs. All three coordinators mentioned 
the goal of building relationships with their business/union partners. One coordinator 
mentioned expansion of the college economic base and student base through on-going 
provision of programs for employees. 
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Managers, trainers & labor representatives - Garry Goodwin, Carpenter's Apprentice 
Program; Daryl Cawley and John Murphy, Bakers, Confectioners & Tobacco Union Local 
#364; Toni McConnel, Warn Industries; Gale Long, Oregon Cutting Systems; Clark Nelson 
and Duane Harris, Nabisco, Inc.; Gary Miller, Teamsters Local 162; and Jim Gillis, 
Leupold & Stevens, were each interviewed by the evaluator during one of the three site 
visits. Comments from all stressed the need for basic skills to support the technical training 
for workplace changes, certifications, etc., given to employees or members. Two 
mentioned the goal of having employees/members know where to look for and be able to 
access learning. A manager noted the goal of having employees improve their self-esteem 
so that they could better handle new responsibilities following planned shifts in management 
during future organizational flattening processes. Another manager spoke of providing an 
opportunity to employees to become "trainable" for rapidly changing job tasks so that the 
company could remain competitive and survive. Union representatives mentioned becoming 
alternate schools or learning centers for educating their members and giving them the 
support they need to maintain jobs and "get ahead" under new workplace technological 
skills or certification requirements. They also mentioned program specific goals of enabling 
drivers to get Commercial Drivers licenses, complete carpenter apprenticeship requirements, 
and master the operation of the computers installed at Nabisco in a timely fashion in order to 
keep their jobs. 

Project Instructors - Each of the instructors was interviewed separately during one of 
the site visits. Comments indicated a desire to assist workers in mastering "real-life job 
problems." Many mentioned increasing learner self-esteem and helping employees "feel 
comfortable" with die learning process. Two instructors felt that program emphasis should 
be on educating the whole person and building everyday living skills, rather than on work- 
related skills. The others all voiced opinions that the programs' content should address at 
least 70% work-related skills. When asked what the most important things for an instructor 
in their program to do were, typical responses included, "to listen and observe," " to tailor 
instruction to employee's goals," and "to forget about traditional ways of teaching and think 
about the applications of skills taught and tiie reasons [employees] have for learning them." 

Learners- Goals of participants were collected in structured focus group interviews 
during site visits and on pre-program and post-program surveys administered by project 
staff throughout instructional cycles. Due to time constraints during site visits, focus 

Prepared by Performance Plus Learning Consultants, Inc. 



Cdumbia-VManvette SkiR BuMers Consortium 

DOE Workplace Literacy Grant Program- Final Evaluation Report 



18 



groups with learners were conducted only with participants in the math program at the 
Carpenters Apprenticeship Trust, the CDL program at the Teamsters Hall, and the English 
for the Workplace program at LWO Corporation. Responses from participants in the union- 
sponsored programs indicated the importance of having a place to study outside of school or 
home, with flexible hours, as well as rec .\/ing help in the support basic skills to enable 
them to reach their career goals. The non-native speakers of English at LWO mentioned 
their desire to learn more about the language so that they could better understand situations 
ai work and better relationships with their supervisors and managers, who communicate in 
English. All participants in the focus groups indicated the goal of receiving job-related 
basic skills training, although among beginning level participants there was also mention of 
wanting to not be limited to learning only job-related, employer-specific English. 
Responses from surveys demonstrated that most participants wanted to either upgrade 
current job skills or prepare for future job/ career tasks. Based on those pre-program 
surveys that contained an open-ended learner goal statement stem, responses indicated 
participant expectations were as follows: * 

pass the test for quality control specialist 
get ready to enter junior coUege 
improve my writing skills for the job 
to learn to type on a computer 

to improve on my math skills & get ready to pass the test for quality technician 

certification 
my GED 

to better my education in reading and writing 
to advance 

to become better with my math skills 

to help me when I start my college course in manufactiuing technology 

be able to ask my supervisor questions 

figure out problems in my sprerid sheets 

be able to read [bluejprints better 

to [be a] better employee 

to learn more 

update training on my current job 
to become an operator 
to know the calculator 
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to do faster set ups and faster counts 

make sure I put out quality parts and insure that others do 

refresh old skills 

self-improvement 

be proficient with percents 

Icam how to read decimals better 

to brush up 

PPLC collected and analyzed goal statements from project director, project 
coordinators, managers, trainers, union representatives, project designers and 
administrators; instructors; and participants. Because individual sites varied the forms 
created by PPLC or failed to collect requested goal statement information, data were 
available on individual learner goals only from the Leupold & Stevens math program and the 
programs at Warn Industries and Oregon Cutting Systems. For a discussion of areas of 
convergence and divergence, please see the evaluation section, "Summary of Results," 
under Discission. PPLC next investigated the input of resources to the project, which is 
addressed in the next section of the evaluation. 
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Project Tnput : 

What resources were available to the project during 
development and implementation and to what extent 
were thev used effectively ? 

This section of the evaluation addresses major resources of the project. It includes 
program instructional materials, design and appropriateness for the targeted learner 
populations; key personnel qualifications and the match between published project duties; 
and facilities. It also examines the content and processes used for instructor training. ITie 
data presented in this section were analyzed for strengths and weaknesses. 

Pro|a-am materials- The instructional materials were designed for each of the sites 
after developers conducted literacy task analysis of various targeted job tasks and 
certifications. Documentation of the literacy task analyses was not available, but progi'am 
developers spoke knowledgeably about the procedures they had used for interviewing and 
observing workers and analyzing materials to determine basic skills applications used in job 
performance. Based on company/union- identified needs published in the grant, 
discussions with trainers, managers, union representatives, and program coordinators from 
the three colleges, the choice of math, communication, keyboarding and reading-study skills 
contained in instructional content and objectives was that identified as necessary for 
piirticipants to perform targeted job tasks or certification procedures. 

Review of the curricula levealed numerous job scenarios and examples taken from 
workplace situations. Several programs,i.e., Leupold & Stevens' Blueprint math and 
LWO's advanced level ESL, adapted commercially available academic skills curricula by 
adding some workplace examples of skills use. Other programs, i.e.. Carpenter's 
Apprentice math, CDL tmcker study skills, iNabisco, and Oregon Cutting Systems, created 
customized learning materials from workplace scenarios and print materials. Two programs 
added to the project midway tlirough the grant, i.e.. Warn Industries and Anodizing, Inc., 
adapted and expanded on customized materials previously created for other programs in the 
project in order to expedite delivery of services to employees. Examples from workplace 
materials across all programs were reproduced at a high level of quality and were up to date. 
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ITie ranges of reading difficulty level for the various instructional materiaJs appeared 
to majch the ability levels of targeted paiticipants. Results of language ability level 
diagnosis for ESL course participants and curriculum content developer-made pretests were 
the only measures of targeted participant ability levels. For example, ESL participants were 
placed in beginning, intennediate, or advanced English classes by levels of proficiency. 
Observations of delivery and aiialysis of beginning and intermediate classes at LWO and 
Oregon Cutting Systems demonstrated the ability of learners at each level to comprehend 
topics and to participate in. learning activities comfortably. Cloze tests used at Nabisco 
indicated targeted participant comprehension levels of reading grade levels 9.0 or higher. 
(Scores from the BASIS test described in the grant, if they exist, were not made available to 
the evaluator. It is not known whether any sites administered this test to their participants or 
not.) 

When asked about the strengths and weaknesses of instructional materials, the 
majority of participants thought the content reinforced skills needed to perform job tasks or 
complete job certification procedures. For example, 92% of partj.cipants in the Warn 
Industries computer class rated materials at either a 5 or 6 on a (-) 1 to 6 (+) point scale. 
Negative comments clustered around the desire for more time on computers and for longer 
classes. At Oregon Cutting Systems, participant comments about materials were similar. At 
Leupold & Stevens, participants in the blueprint math class indicated a desire for more 
practice exercises. Other programs did not collect the requested data on learners' to 
evaluation of materials for effectiveness. 

Instructor guidelines scripted for individual course sessions were developed only for 
the materials used with the CDL course for truck drivers. These were in the format of one- 
page activity outlines that included a rationale statement, a listing of the processes and sldlls 
to be taught, a context building activity, vocabulary words to emphasize, and directions for 
using handouts and worksheets with leamers. The LWO ESL "Buddy Program" provided 
L5 pages of directions for participants explaining overall usdge of handouts. Materials 
from each of tiie other prograin^s did not include directions for instructors; ratiier, they 
consisted of just the worksheets and handoins for instructors to use. 

K?x£sr5.QnB£i • I-^ograni coordinators from the colleges had established working 
relationships with their business/labor partners prior to receipt of the grant. In addition, 
riiey had some experience in providing workplace programs. For example, Nikid Sullivan 
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had set up and managed a number of workplace literacy programs for her college, Portland 
Community College, with several companies in the community. 

■ 

Instructors were seasoned community college teachers with expertise and years of 
experience in adult basic education, Enghsh as a Second Language, md developmental 
studies. Scott Copeland had previous experience as a corporate trainer in designing, 
developing, and delivering workplace literacy programs in another state. Curriculum was 
usually developed by the insfcructors who delivered it Other than Mr. Copeland, none had 
previous experience with creating functional context materials for workplace literacy 
instruction. Most of the instructors commented on the unexpectedly large amounts of time 
they needed to spend on curriculum development, well beyond the number of part-time 
horn s for which they were budgeted and compensated. 

The project directors, Steve Reder and Karen Wikelund, had been written into the 
original grant as project evaluators for Northwest Regional Education Laboratory; federally 
mandated changes in the grant structure reassigned them to tiie roles of project directors for 
activities, without control of the budget. This created some confusion as to functions of the 
project directors in relationship to the consortium. The coordinators from each college 
carried out the day to day supervision of site activities, making the administrative hierarchy 
somewhat superfluous. The NWREL, which was instrumental in writing uie grant 
proposal, had allocated 10% and 15% of Reder's and Wikeluiid's time, respectively, to 
grant work as evaluators under the original stmcture ; in their new roles as directors, 
consortium members reported that this unchanged allotment proved to be insufficient time to 
monitor a project of tlii*; size and complexity and to provide the support needed by the 
college and site staffs. Comments from all tiiree college coordinators indicated feelings of 
frustration resuiting from the infrequent involvement with the project by NWREL staff, 
despite the lab's designation as being in a project leadership lole. 

EaciMss Sessions were conducted in a variety of worksite locations, llie majority 
were held in training and meeting rooms of partner companies or labor organizations. At the 
Carpenter Apprentice program, a small room was provided adjacent to the shop floor so that 
participants could access instruction on an as-needed, .mmediate basis, during trade training 
modules. At LWO, a frame house next to the plant was used to house classes in several 
refurbished rooms. All facilities observed during the three site visits appeared well lit and 
conveniently located, with adequate space for conducting learning activities. 
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Instructor Training- Initial training was provided for project staff in the form of two 
separate workshops, delivered by Thomas Sticht and by Jorie Pliilippi just prior to and 
during the initial stages of the grant period. The purpose of these one-time, brief 
workshops, (e.g., 4 hours), was to convey information to project staff about the functional 
context approach to workplace literacy, the conducting of literacy task analyses, and the 
development of workplace literacy curriculum. Curriculum developers and instructors 
commented that the effectiveness of these workshops was limited because of the short 
amount of time allocated to the in-depth training needed and because of turn-over in staff. 
Those who had attended the workshops often terminated relationships with the project sites, 
and their replacements did not receive any further training. Responses to interview 
questions also indicated that instructors, developers and coordinators had anticipated 
additional inservice training and support from NWREL throughout the project that was not 
forthcoming. Comments included references to "feeling abandoned," "isolated," "don't 
really know how to do any of this," and "simply overwhelming." Many responses focused 
on the lack of preparedness for dealing with the politics of workplace environments on a 
day-to-day basis. 

Instructors reponed that no formal training was provided to them on delivery of 
instruction in the workplace; however, since instructors and curriculum developers for 
programs were often the same person(s), this added the strength of complete knowledge of 
instructional objectives, content and activities to the delivery of many of the programs. On 
the other hand, those instructors hiiied to deliver instruction who were not involved in its 
creation reported that they "v/ercn't sure what to do," and tended to articulate course goals 
and perceptions of their roles that were limited to traditional approaches and philosophies of 
school-oriented adult basic education or ESL. 

For a discussion of strengths and weaknesses of available project resources and the 
effectiveness of their use, see "Summary of Results" under Discussion section of the 
evaluation. The next section of this evaluation examines the process of project delivery. 
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Project Prcx:e.ss : - 

I q what extent were program development and observed 
instruction congruent with project goals and research on 
instrucional effectiveness ? 

Instructiona l Organization - Across sites, the formal class sessions held during the 
project were of 1-3 hours duration and met one or two times per week for 4-10 week cycles. 
Those sites with walk-in learning centers, such as the Carpenters' Apprenticeship math 
program, the Targeted Learning Center for Oregon Cutting Systems, Nabisco's 
Individualized Skill Enhancement program and the Teamster's CDL study course for 
truckers, were operated on open-entry/ open-exit formats with 12-15 hours of instructor 
time scheduled per week. 

The nature of instruction and types of learning activities were determined through 
observation as well as interviews with both instructors and learners. Both learners and 
instructors reported that approximately 80% of instructional time was spent working 
independently, in small groups or pairs, with another 20% of time spent working as a whole 
group. Only the ESL participant focus groups reported estimated time spent in whole group 
instruction to be 90-95 %, while their instructors thought they spent about 15 % of 
instructional time working with this group as a whole class. Records from 6 class 
observations by die evaluator indicated an average of 39% of instructional time spent in 
whole group instruction employing lecture techniques. This compares favorably with an 
ideal of less than 50% teacher-talk during any one instructional session (Goodlad). On-site 
interviews and observations occurred two times during the middle phase of the project, in 
November, 1990, and late January, 1991. 

Instructional Engaged Time- Learner engaged times during observations was quite 
high. Most leamers appeared to want to learn, seemed to enjoy moving through the 
instructional units, and spent 85%-92% of time in the classroom actually participating in 
communication exercises. This compares witii engaged times of 40%-50% reported for 
observations of high school classrooms (Mikulecky). Adult leamers came ready to work 
and managed twice as much effort per hour as adolescents manage in school rooms. 
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Instrucrional Quality- The quality of instruction provided by the materials has been 
discussed earlier in the Input section of this evaluation. It was, for the most part, quite 
high. All instructors observed had established good rapport with learners and took an active 
role in monitoring learner progress, encouraging learners, and providing explanations when 
necessary. The only instances involving instructor provision of supplementary materials 
were observed in ESL delivery of instruction at various sites. 

Solid judgements of the quality of instructor explanations of concepts are not 
possible given the fact that explanations and comments to learners were, for the most pait, 
privately conducted one-on-one and could be overheard in less than a dozen instances. In 
these instances, however, a good deal of variation existed in instructor ability to explain the 
thought processes for the job-related basic skills applications procedures being taught One 
instructor was able to explain several approaches to mathematics in a manner which 
elucidated the thought processes involved. The other instructors observed fell back to 
simply repeating procedures from instructional materials, stating step-by-step processes for 
memorization. Little or no Draining was provided to either curriculum developers or 
instructors in how to model such thought processes. This is in contrast with cuire..' 
preservice and inservice practices for workplace literacy instructors in both the military and 
private sectors that result in highly effective delivery of instruction through training that 
refocuses instructional delivery practices from the teaching of memorized procedures to the 
teaching of comprehension via modeling thought processes (metacognition). 

Instructional Environment - Several unforeseen and uncontrollable external events 
impacted on program delivery. These ranged from union/management negotiations 
concerning plant down-sizing issues and seasonal layoffs to trained instructors/curriculum 
developers leaving the project to obtain full-time employment. The turn-over in 
instructors/curriculum developers became a catalyst for: a.), sharing of staff members to fill 
in the gaps and perform these functions for more than one of the community colleges, and 
b.), being able to provide "shared" staff members with multiple part-time opportunities that 
added up to full-time employment across programs. Labor/ management situations were 
resolved by holding classes on company time at one site. On a less successful note, 
seasonal layoffs at another program site substantially reduced participant attendance and 
subsequent company support for the program. 
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For a discussion of project process, please see "Summary of Results" under 
DisCHS?siQn section of the evaluation. Following receipt of final data in March, 1992, PPLC 
assessed program outcomes (or "product") to determine the degree of project effectiveness. 
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Project Product : 

To what extent are tliere indicators of project effectiveness ? 

The C.I.P.P. model enables gathering of evaluation data from more than one source 
to promote triangulation of results in an attempt to arrive at valid conclusions concer^.iiig 
project effectiveness. PPLC evaluated the Columbia- Willamette Skill Builders Consortium 
Workplace Literacy Project from three different perspectives of the users: 

• participant pretest/posttest scores and statements concerning 
achievement of personal learning goals and value of the course(s); 

• anecdotal reports from instructors, recording particij^ant 
applications of course content to work-related and everyday tasks 
outside of class; 

• supervisor post-course ratings of participants. 

Meeting Participants' Goals- The first aspect of project product effectiveness was the 
collection on pre- and post-program surveys and from on-site interviews of data concerning 
the degree to which participants in the various programs were able to achieve their personal 
learning goals. During interviews, most learners expressed satisfaction with the content of 
courses. A frequendy mentioned asset was the building of confidence that enabled 
participants to use the skills they were learning in order to pass certification exams or GED 
tests, improve current job task performance or prepare for quality procedures and 
technological equipment upgrades in the near future. The only exceptions came from ESL 
program participants at LWO and Oregon Cutting Systems who: 1.), felt threatened by 
program content they (beginning level learners) perceived to be too narrowly aligned witii 
company-specific job tasks; and , 2.), thought they (mtermcdiate level learners) should be 
receiving instruction more suited to their perceived higher proficiency levels. In asking 
learners to rate the program, the evaluator heard that the contents, instructors and schedules 
all earned "A" or "B" grades. Their reasons included liking the small groups because they 
got tiieir individual questions answered, well-prepared instructors who seemed to really 
understand participants' jobs, convenience of meeting times and locations, and die relevance 
of materials to their job needs. 
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Participants reiterated many of the reasons they had given for wanting to take the 
course (see Context section of evaluation) as having been accomplished, when asked,"What 
can you do now that you couldn't do before taking this course?" (See Figure 1 for a 
detailed listing of learner responses. PLEASE NOTE: Many responses received on poorly 
duplicated copies of data collection forms were illegible and could not be included.) Of 
those learners completing data collection forms that asked if their program "had helped them 
reach or make progress toward any of [their] work-related or non-work relatt 1 personal 
goals," 63% reported that it had. Additionally, when asked if they "would recommend 
participation in the program to a co-worker," 96% of the learners reported that they would 

Of those learners completing data collection forms that asked them to rate their 
program on polarized scales for the program's interest level, usefulness on the job, 
difficulty level, usefulness outside of work, and whether or not it had been what learners 
expected, the results as shown on Table 1 were obtained. 



Table 1: Post-program participants' evaluation of course from analysis of responses to Item # 11 on 
Participant Post-Program Survey. (See Appendix A for copy of data collection instrument and site 
variations.) n= 151 





5 


4 


3 


2 


1 




Interesting 


63% 


29% 


8% 


0% 




Boring 


Useful on the job 


41%- 


21% 


9% 


9% 


mo 


Useless on the job 


Too difficult 


1% 


7% 


25% 


28% 


39% 


Too easy 


Useful outside 
of work 


37% 


37% 


11% 


6% 


9% 


Useless outside 
of work 


Exactly what 
I expected 


53% 


27% 


14% 


3% 


3% 


Not at all what 
I expected 



From Table 1, one can conclude that 100% of the participants found the programs to 
be extremely to moderately interesting. Sixty-two percent found them quite useful for their 
jobs. Only twenty-five percent of learners rated the programs as being at the appropriate 
' ;vel of difficulty, i.e., neither too difficult nor too easy, while 40 % found the programs to 
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be completely out of their range of abilities, rating it with a "5" or a "1." Eighty-five percent 
of learners also found program contents to be extremely to moderately useful outside of 
work. It is important to note that 53 % of learners reported that the program was exacdy 
what they expected it would be, and another 41% felt that it was somewhat like what they 
expected it would be. Studies conducted on persisters and leavers in adult learning 
programs strongly support findings that adult learners tend to remain in programs that meet 
their expectations Parkenwald, 1984). This reflects appropriate advertising of program 
content and goals and is worth noting for future program promotions, as well. 

Paired sets of participants* pretest-posttest scores were available from Nabisco's 
math program. Warn Industries' shop math and computer programs,the Carpenters' 
Apprenticeship program, the CDL study skills program. Anodizing's math program, one 
ESL class at Leupold & Stevens, and one ESL class conducted at LWO. The greatest gain, 
134.0%, wa.s achieved in the shortest number of contact hours, 1 to 6, by participants in the 
Carpenters' Apprenticeship Math program. This may be due to the nature of the content, 
much of which focused on showing learners how to compute job task formulas, 
conversions, and measurements using a scientific calculator. J^oper calculator use normally 
increases speed and accuracy of calculations. 

The least amount of gain, 5.3%, was evidenced in data from the Beginning level 
ESL program at LWO. This may be due to the need for limited English proficient speakers 
to generally continue instruction for much longer than 21 hours in order to perceive 
measurable gains in beginning second language performance. 

The results from Anodizing, Inc.'s Math program, 94.6% increase in 10 hours, also 
appear greatly in excess of the gains by oiher programs in a shorter amount of contact 
hours. This may be due to the content of the course, which primarily addressed fractions, 
decimals and percents. If workers were previously exposed to these math topics during 
formal schooling and had merely forgotten them from disuse, pardcipation in a concentrated 
brush-up course such as this may have enabled them to recall and master under-leanied math 
skills and account ^pr the gain scores. Table 2 below displays the results for each program 
that collected this data. 
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Table 2; Pretest/ posttest averaged percent gains per program. 



Program 


Number of 
Participants 
Tested 


Number of 
Instructional 
Contact Hours 


Average 
% of Gain 
Pretest/Posttest 


Warn Industries Shop Math 


11=29 


20 hrs. 


+ 18.4% 


Warn Industries Computer 


11=41 


16 hrs. (average) 


+ 20.5% 


Leupold &Stevens ESL 


n=8 


20 hrs. 


+ 12.6% 


Nabisco, Inc. Math 


n=42 


19.5 hrs.(average) 


+ 26.0% 


LWO ESL, Beginning Level 


n=18 


21 hrs. 


+ 5.3% 


Carpenters'Apprentice Math 


n=307 


1 to 6 h':s. (average) 


+ 134.0% 


CDL Study Skills 


11=92 


11 hr'S. (average) 


+ 35.4% 


Anodizing, Inc. Math 


11=72 


10 hrs. 


+ 94.6% 
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Based on participant goal statements and their close match with program mstructional 
content and objectives, the pre-/posttest gains provide strong evidence that programs were 
effective in helping participants work toward or achieve their personal learning goals. 



Figure 1 

Participants' responses to "What can you do now 

that you couldn't do before taking this course?" 

Typing skills improved 



Read a tape measure and know what I'm 

doing instead of just guessing 
Understand my work better on the job 
Work faster 

Use calculator to do fractions, decimals 
Can convert fractions and decimals 
Use the right formula for each situation 
Helped me brush up on calculator skills 
Comfortable doing right triangle 
computations 
Math! 

Be more secure and more patient 

Work a lot faster with percentages 

Figure angles and inches 

Multiply and divide fractions, decimals 

Cancel and invert 

Have a better grasp on decimals 

Got my GED 

Helps me work at home 

Improved my learning skills 

Undentand better how I read and write 

Better basic skills 

Have more confidence in myself; I'm 
taking more classes at work and am not 
afraid to do things anymore 
Read and write much better English 
Feel good to myself; can get more 
educating now 

Present formal letters in typed format now 
Understand more about computers- but 

I still don't like tiiem! 
Found out I have an aptitude for 

computers 

Can use new methods on my job 
Computer language 
More comfortable with computers 
Showed me I have a lot to leam 
Learned the basics before complex 
problem 



Know a litUe more than I did before 
How to get help when running 
applications 

Wordprocessing on spreadsheets 
Can do memos all by myself 
Basic navigation 
Doing graphs 

How to turn on computer and use files 
Can do my own projects 
Turning on the computer 
Format a disc 

Run a PC now fairly confidentiy 
Use WordPerfect 
Understand new programs easier 
Understand terminology used in field 
Not afraid of hurting programs 

anymore 
The vocabulary words 
Bought a eomputer since class; have 

taught myself more 
Don't know 
Less fear 

Can access information about parts 
Able to program work info 
Don't have to ask other people for 
help 

Don't feel afi^dd now when a team- 
leader helps me 

Can se'j where w e can be more 
effective in our department 
Charts 

Sit at a PC and run it (somewhat) 
Further my education 
Ask supervisors questions 
Talk more to other workers 
A littie algebra 
Percents 
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Instructor Anecdotal Records- To determine how and if learners were transferring 
new concepts and skills to applications on the job or outside of work, PPLC requested site 
instructors to report any instances of participants referencing situations in which they were 
using outside of class what they learned. An anecdotal recordkeeping form was supplied 
for this purpose. (See Appendix A for copy of data collection form used.) Information was 
gathered by only 3 instructors. Learner comments included references to: 1.), improved 
math ability on the job, such as being able to calculate more quickly and more accurately; 
2.), certification tests passed for job positions and the CDL, as well as for the GED; 3.), 
quicker reading and processing of work orders; 4.), better speaking and writing skills; and, 
5.), increased confidence and decisions to continue with more education. 

Supervisor Ratings of Participants- Post-program participant ratings by supervisors 
were collected by six programs at four of the sites. Some used 5-point Likert scales 
developed by PPLC; other sites created their own forms. For this reason it is not possible 
to ccn'ipare data across sites. Results and representative comments arc listed below by 
program. (See Appendix A for a copy of the supervisor rating form.) 

♦ Oregon Cutting Systems Computer program: 

Supervisors surveyed indicated that they were unaware their employees had 
taken a computer class. Only 15% reported any noticeable improvement in 
employee performance following the class. Another 30% commented that 
they did not feel computer training was relevant to their employees' job 
duties. (Returned survey n = 6.) 

♦ Warn Industries Shop Math program: 

Supervisors surveyed indicated that they did not detect noticeable changes in 
either production or quality of work following program participation. Their 
responses showed that they felt their employees' abilities to cope with future 
changes and to solve problems cooperatively had improved somewhat 
Specific changes noted in comments addressed individual employees' newly 
acquired abilities to do inventory transactions, cycle counting, problem 
solving, and accurate calculations on time cards and production jobs. 
(Returned survey n = 33.) 
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• Warn Industries Computer program: 

Supervisors surveyed indicated that they saw a slight improvement in 
production and quality of work, ability to cope with future changes and to 
solve problems cooperatively. Their comments referenced both positive and 
negative changes observed in individual employees following program 
participation. For example, in some employees they noticed more 
confidence in working v/ith computers, increased contributions to the 
department, and greater facility for producing memos, meeting notices and 
minutes. In otiier employees tliey noticed increased frustration when dealing 
with computers and concern that those employees who are not currentiy 
required to work with computers will forget what tiiey learned when the time 
eventually comes to apply tiieir new skills. (Returned survey n = 19.) 

• Leupold & Stevens ESL program: 

Supervisors rated participants on 4-point rating scales. Results indicated that 
they felt all of their employees who completed the program demonstrated 
some improvement in making suggestions. They indicated that 70% of tiieir 
employees increased oral interaction witii coworkers- 10% significantiy, 
40% noticeably increased the number of times they speak up while 
perfonning job tasks, and 50% of tiieir employees showed noticeable 
increases in self-confidence, (a for supervisors surveyed not reported.) 

• Leupold & Stevens Blueprint Math program: 

Supervisors surveyed indicated tiiat 77% of tiieir employees demonstrated 
significantiy greater cooperation and problem-solving abilities since 
particpating in tiie program. Their responses also indicated tiiat 64% of tiieir 
employees were noticeably applying skills learned to job tasks, and that tiiey 
felt tiiat all tiieir employees would be better able to handle new procedures 
introduced into tiieir departments in tiie future. Specific comments about 
individual employees noted enhanced quality monitoring and inspection 
skills plus increased self -confidence. (Returned survey n = 22.) 

• Nabisco, Inc. Math and Skill Enhancement programs: 

Supervisors surveyed indicated tiiat quantity of work produced by all tiieir 
employees had increased, quality of work for 80% of tiieir employees had 
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improved to a high level of accuracy, and attendance for 60% had greatly 
improved. They reported that 60% of their employees now need less 
supervision and the remaining 40% are now able to work independently. 
They also noted somewhat to greatly improved job attitudes in all their 
employees. Comments about individual employees gave examples like the 
following: "Doesn't ask the supervisor as many questions," "is more 
confident; knows how to use the calculator," "helps other employees with 
math," "interacts" with others- before he was a loner," and "knows his math 
skills." One supervisor was asked to comment on program impact on her 
department and responded, "[Employees] can confidently convert ingredients 
to decimal figures, cut ingredients in half for recipes, and understand 
process." (Returned survey n = 5.) 

Additional data : Several programs also submitted indicators of program 
effectiveness gathered from comments by organizational managers at their sites. These 
included the following: 

Warn Industries. Inc.- has hired program instructor/curriculum developer Scott 
Copeland full-time as corporate basic skills trainer. 

Labor-sDonsored Carpenter's Apprenti ce and CDL drivers p rngram^}- instruction 
will continue to be offered to members at each established learning center beyond the 
grant period. 

Anodizing. Inc.- Has requested program to be continued; will pay instructor. 

L^UP9l4 & Stgvens- has cost of program continuation and instructor salary under 
budget consideration. 

N^l?i?gp, Inc.- has offered to pay instructor to continue program. 

The v/iUingness of these sponsoring partner organization(s) to pick up expenses for 
continuing the programs beyond the grant indicates that they perceived a cost benefit from 
participating in them. 
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Discussion 

Limitarions of this study - Three factors limited the ability of this study to draw definitive 
conclusions from the evaluation. The first was the inconsistency of data able to be collected 
across sites. Reduction of the originally budgeted time and financial resources allotted to 
project evaluation, 15% and 10% of time for two full-time NWREL principal staffpersons, 
or approximately 62 person days, to only 6 person days resulted in insufficient time 
available for thorough and complete investigation of aspects concerning each program 
delivery site this complex project 

The second limiting factor was the directive from the project director that all 
communication between project personnel and the extemal evaluator pass through his office. 
This was mandated during the last four months of project operations, following feedback to 
the project director after unsolicited contact of the evaluator by the project's college 
coordinators expressing their concern over the absence of contact and guidance from 
NWREL for extended periods of time and their data collection requirements. Denying the 
evaluator direct access to site coordinators and instructors immediately involved with the 
daily program activities, and forwarding reproduced copies of portions of original data, 
resulted in many queries on details and issues of clarification that had to be left unanswered. 
It also raised questions as to why original data, as requesied, was not sent, and as to the 
nature of the selection process imposed on that data forwarded by NWREL to the evaluator. 

The third limiting factor was the difficulty experienced by the evaluator in collecting 
and obtaining some of the requested data from the program providers in a timely fashion and 
in the formats required for inclusion in the evaluation. Unfortunately, the absence of some 
key program measures that were requested throughout the project severely limits the 
evaluator's abitity to draw conclusions about the overall effectiveness of this demonstration. 

Summary of Results- The following statements provide summary and discussion of key 
findings from the evaluation of project context, input, process, and product. 

Cpntgxt - The extent to which the goals and philosophy of the project were shared by key 
project personnel and learners was found to be as follows: 
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Areas of consensus : There was a good deal of consensus about program goals 
among project directors, coordinators, managers, and the program developers. All 
highlighted the importance of the instruction as a means for mastery of basic skills and their 
applications to job tasks and requirements. Tlie use of these skills to foster workers' 
abilities to enhance career opportunities and job performance was mentioned by all. 
Participants also commented on their desire to improve these skills and on the programs' 
relevance to accomplishing their personal goals. 

Areas of divergence : The main areas of divergence were evidenced during 
interviews in the responses of those instructors not direcdy involved with curriculum 
development, namely their reluctance to commit to organizational goals for totally job- 
relevant programs. They all commented on their desire to make the programs more life-skill 
oriented in content, rather than adhering to the goal for providing the job-specific workplace 
programs agreed to by the consortium and partnering organizations. There appeared to a 
lack of understanding among these instructors of the nature of the overall purpose and 
functional context design of workplace literacy programs. Such mixed philosophies 
between materials developers and deliverers are in direct conflict with the consortium's 
goals for the project. 

These observations should not be taken to mean that instructors were not doing their 
jobs. Participants expressed indications tiiat they perceived themselves to be learning skills 
they could apply in die workplace and were having tiieir needs met. Most learners were 
satisfied with their experiences, sometimes because of instructor personal attention. 

It may be, however, that the informal and variable types of pre-service training 
provided for instructors was insufficient to guarantee their internalizing program goals. With 
such brief and erratic training, it is likely that instructors will maintain whatever learner 
goals tiiey have used previously, Widi development of instructor training materials carefally 
structured to include guidance, modeling, and post-tiraining assessment of delivery skills, 
tiiis problem might have been alleviated. 

Additionally, the two college administrators' remarks indicated a preference for a 
more generic approach to provision of basic skills to workers. They appeared to see the 
project only as a source of monies for current budget commitments, not as a means for 
developing longterm relationships as service providers for local businesses/ unions. They 

Prepared by Performance Plus Learning Consultants. Inc. 



Cduwbia-wmiametie Skill Builders ConsorHum 

DOE Workplace Literacy Grant Program- Final Evaluation Report 



37 



did not make any mention of using the grant period to extend college services nor view the 
project as a means for generating new sources of revenue or larger student bases. 
Depending on their extent of involventwnt with project decisions concerning the extent of 
actual development of materials and implementation of courses, this also presented a 
potential conflict in program philosophy and direction. 

Input - The availability to the project of resources during development and implementation 
and to what extent they were effectively used was found to be as follows: 

Strengths and Weaknesses - The curriculum materials developed for the program 
contained numerous job task and certification requirement examples of skill applications, 
enabling learners to practice skills in ways they would use for the workplace. Resources for 
program development appeared adequate financiaUy for instructional delivery, but unrealistic 
materials development time lines impacted on the stress level of the inexperienced 
developers. Many of the instructor/developers expressed fiustration with the unanticipated 
large amounts of time necessary for them to commit to conducting literacy task analyses and 
preparing functionally contextual curriculum materials ftom the results. Had the 
instructor/developers been hired under the grant as full-time employees with benefits, they 
might have been better able to accommodate and rationalize the number of hours they needed 
to invest in curriculum development Instead, they were paid only for instructional hours, at 
part-time adult educator hourly rates. 

All three college coordinators also commented on learning how to budget their time 
working on the project appropriately, as well. All felt that the amount of time required for 
conducting essential liaison activities with business/labor partners on a daily basis was far in 
excess of their original expectations. One remarked on learning from the project how very 
unpredictable and volatile the culture of the workplace is, subject to sudden and dramatic 
changes as a result of internal organizational politics or the economy. Keeping accessibility 
and visibility high requires a great deal of frequency and regularity of physical presence. 
The other two both commented on the necessity for allocating a minimum of several full 
days per week to monitoring and assisting with program activities at sites. 

Content of most of the program curricula was well designed, including the modeling 
of thought processes. The resulting original materials created for the project contain strong 
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lessons that offer participants opportunities to develop cognitive awareness of their thinking 
strategies during applications of basic skills to job tasks and certification requirements, and 
that enhance the probability of continued application of those skills learned. Tlie inclusion 
of pre- and post-tests or assessments for most curricula provided strong evidence that 
participants made progress in mastering the content of the programs. 

The content of several of the curricula included a number of previously published 
excerpts from other commercially available sources. Using others' words and ideas 
anonymously, without first obtaining written permission from the copyright holders and 
authors, is a major flaw in the curriculum design and development of these particular 
programs. Inclusion in subsequent publishing or dissemination of project curricula could 
also lead to legal ramifications for the project administrators. 

Instructor and program developer qualifications and previous experience were rich 
and highly professional; they provided a definite enhancement to the program overall. 
Criteria might be derived from a composite profile of the qualifications and background of 
these key personnel for use as hiring guidelines for project or program institutionalization or 
Implication. 

Instructor training sessions proved to be inadequate; they did not provide the total 
support system that the program needed for fiill acceptance by the instructors, congruence of 
purpose and mastery of techniques among the developers. The brief duration and one-time 
deliveries of the two training sessions addressing the complex craft of creating functional 
context workplace literacy curricula did not satisfactorily meet the needs of project personnel 
for preparing to become curriculum developers and workplace instructors, for ongoing 
support, or for dealing with the issue of late hires due to normally anticipated rates of 
turnover among part-time staff. 

Definitions of roles and duties was mentioned by all. The project directors from 
NWREL commented on the federally mandated revisions to the original grant structure that 
changed their role from that of project evaluators to directors. Their initial mind-sets for 
structuring their functions seemed firmly cast This was eviden*^ in their reluctance to 
assume a leadership, support role with the consortium, and in their controlling attitude 
toward data collection, i.e., in establishing themselves as the intermediary agency through 
which all data must flow from the sites to the evaluator. It was also reflected in the lab- 
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generated data collection instruments ihat sites often substituted for PPLC-developed tools. 
These were computer-analysis, outcome-oriented instruments that omitted many of the items 
requested by the external evaluator. 

College coordinators remarked that following the federally mandated revisions to the 
original grant proposal, no meeting was ever held with all consortium members to define 
adjusted roles and duties. This resulted in frustration, lack of cohesions, and occasional 
misunderstandings between the colleges arl the lab. 

College coordinators and project directors all mentioned that being administrators 
without control of the project budget, or even of program specific portions of it, caused 
logistical problems resulting in time lags in receiving up-to-date balance sheets and in 
knowledge of what monies could or could not be expended on immediate project needs. 

Instructor/curriculum developers commented frequently on their lack of prior 
knowledge as to toe extent of their duties in this previously unknown specified instructional 
area and how much time and effort would be involved in developing curricula. Most 
thought that they had been hired as part-time houriy adult education instructors and that die 
curricula would be available off-the-shelf firom commercial publishers. Experience with 
developing an occasional student exercise did not prepare them for the intensiveness and 
complexity necessai-y for creating entire courses related to job performance or requirements. 



Process- The extent to which program development and observed instruction were 
congruent with program goals and research on instructional effectiveness follows: 

Areas of convergence an^ ^ divergence : Learner engaged time was quite high and 
learners spent 85-92% of dime in the classroom actually participating in skill building 
activities. Botii instnjctors and participants appeared motivated to take full benefit of 
instruction time and took pride in the efforts made. 

The quality of instruction was good overall. Each instructor that was observed 
appeared to be engaged in "reciprocal learning" with the learners and displayed a caring 
attitude and willingness to assist learners achieve their goals. Evidence varied from 
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instructor to instructor in ability to demonstrate the thinking processes necessary for 
applications of workplace basic skills to be taught effectively. 

The project well exceeded its goal for providing services to approximately 300 
participants and enrolled a ' al of 776 workers. This is a strong indication that overall, 
recruitment and everyday relationships with partnering organizations were operating well. 
The programs that reported dwindling attendance were those addressing English as a 
Second Language. This may have been due to the generic ESL content of courses delivered 
by instructors not involved in creating functionally contextual workplace curricula or to 
changes in perceived employer program support external to instruction. 



Product - The impact of the program was assessed with a combination of indicators, 
including comments from learners and instructois, and supervisor ratings. A summary of 
the results follows. 

Business and industry organizations normally evaluate training on four levels. Because 
workplace literacy programs are directly related to assisting workers attain career goals by 
meeting job requirements and improving performance on job tasks, it is appropriate to 
measure program outcomes using this yardstick: 

Level I- does the proposed program match with an identified organizational need? In this 
case, the project programs were desired by each of the partnering organizations to enable 
their members to function better tiirough improved workplace applications basic skills. The 
grant application shows that specific job tasks and special need? of each cooperating 
organization were identified and targeted, (Table 2). The job tasks and requirements were 
carefully selected and analyzed tiirough literacy task analyses, from which the curricula were 
then developed. 

Level 11- do the participants selected for training master the content of the training program? 
Impressive gains from prc-Zposttest scores, instructor anecdotal reports, and numerous post- 
program statements by participants compared to pre-program goal statements, provide 
strong evidence tiiat participants mastered tiie content of programs for which this data was 
collected. 
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Level III- do those participants who master training demonstrate improved job performance 
in areas identified as critical to show positive transfer of learning? Post-program raiings of 
participants by supervisors indicated that in only half of the programs did supervisors notice 
significant changes in employee performance. Of those that did see improvements, tt;ey 
were able to identify specific observable, measurable behaviors that clearly demonstrated 
positive transfer of course content to job tasks. 

Level N - does impact on performance lead to demonstrable cost benefits, i.e., money 
saved or generated, by the positive changes in employee behavior? In this case, the 
organizations indicating positive program impact did not report any cross-referencing of 
individual productivity or behavioral indicators with performance appraisals, the supervisor 
ratings and instructional objectives of the programs. No data exists, therefore, for 
determining the possible cost-benefits derived from employee participation in the programs. 
The actions under consideration, or already taken, by some of the partnering business/labor 
organizations to continue programs beyond die grant period indicates satisfaction with 
services as benefitting the organization. 
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Conclusions and Recommendations 

Based on the results of this evaluation, the following conclusions and 
recommendations concerning stated grant goals are offered. 

There is strong evidence showing: 

♦ learner increases in specific job-related skills and in basic math, reading, 
writing, and English language skills; 

♦ learner enhancement of problem-solving skills, promotability, employment 
prospects and increased self-confidence; 

♦ educator enhanced knowledge of skills needed by local businesses and 
industries; and 

♦ sharing of resources and expertise among consortium members. 
There is only a moderate amount of evidence indicating: 

♦ improved employee performance and productivity on targeted jobs and 
ability to adapt to changing workplaces; 

♦ educator increased knowledge and expertise the field of workplace 
literacy; and 

♦ removal of [perceived] barriers to instruction for target groups, e.g., 
cost, relevance, logistics, lack of confidence, childcare, transportation, 
and training materials. 

Recommendaricns : 

1. Eliminate subjectivity and vagueness of supervisor rating instruments; 
work with supervisors on an individual site basis to identify specific 
observable, measurable performance behaviors that are related to program 
instructional objectives and that can be used as concrete indicators of transfer 
of learning to job performance. 
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2. Strengthen project training by lengthening initial how-to sessions for 
learning functional context v;orkplace curriculum development techniques 
and by providing inservice aj; well as preservice training to all instructors and 
curriculum developers. Develop pre-delivery training sessions for 
instructors not involved in cn;ating curricula and provide them with 
instructor guidelines for each unit of instruction. 

3. Determine whether or not each of these perceived barriers acmally exists, 
prior to budgeting resources and energy for its removal, i.**-. childcare, 
transportation, etc. Collect data, first to establish existence of each barrier 
and then to determine the extent of the project's ability to eliminate it. 

There is litde or no evidence showing: 

• learner access to vocational and educational counseling services; 

• apprenticeships, certifications, promotions for a population of at least 300 
participants; 

• expanded Adult Basic Education delivery and outreach by community 
colleges; 

• establisb-^ ient of ongoing partnerships between industry and education; 

• establishment of a regional network of workplace literacy experts and 
spokespersons; 

• development of methodology for assessing workplace literacy needs; 

• provision of a network infrastructure for dissemination of project results; and 

• launching of a Nortiiwest Workplace Literacy Campaign. 

Recommendations ! 

1. .If individual counseling is a part of the program, maintain records to 
determine need for these services, nature of services and resources, 
frequency o^use, and impact on participants' attainment of program goals. 

2. If apprenticeships, certifications, and promotions are to be used as 
measures of program success, collect data that indicates the number of 
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participants entering the program who arc seeking these outcomes and the 
number who achieve them. Determine whether there are any other variables 
that might impact on attaining these outcomes and control for them before 
claiming program responsibility for their attainment or lack of attainment by 
participants. 

3. Obtain commitment of college administrators to permanent support for 
program development and program staff positions. Determine whether or 
not amendments or emendments to existing institutional financial and 
organizational structures need to I^e made to facilitate this ongoing support 
Evaluate institutional philosophy, longrange goals and motives for 
participation. 

4. Obtain commitment of businessAabor organizations to permanent support 
for program development and delivery. Determine organizational critical 
needs and establish advisory panel at each site to actively work with program 
providers. Work to obtain buy-in at se"eral levels: upper njanagement, 
training and education, supervision; i ie comparable levels of union 
representatives. 

5. Research available methodology for assessing workplace literacy needs 
and the effectiveness of various techniques and procedures. Create 
additional methods and variations based on situational needs that direcdy link 
program provision to identified workplace performance needs and upcoming 
changes. Anticipate more than one appropriate method. 
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Appendix 
Data Collection Instruments 
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I. PPLC Evaluation Forms 
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Workplace Literacy Programs 
Evaluation Guidelines 



Fftr Arimtnlft^TBt^TC usc onlv 
Entry date: 

PARTICIPANT PRE-TRAINING SURVEY Exit Date: 

I. Personal Infonnation 

Name 

(Last) (Flist) (Middle IntUal) 

Current Address: 

(Street and Number) 

Wl ^at^ (apCod^ (County) 

Telephone number: Birthdate: 

(Month) (Day) (Year) 

1 . What is your age group? 

16-18yis. 19-25yre. 26^yES. 36-5()yrs. v51-65yre. 6&+yik 

2. Wliat Is your ethnic group? 

l._White 2. Black 3. Indian 4. Hispanic 5. Other 

3. What Is your gender? l. Male 2. Female 

n. Employment Information . 

4. Are you now employed? 1. ^Yes 2. No 

5. What company do you work for? 

6. How long have you worked for this company? 



Lessthan l-2yis. 3-5yrs, 6-lOyis. morethan 

If- lOyis 

7. What is your J ob Utle? 

8. How long have you worked in this Job title? 

(beglnnliTgdateJ 

9. What other Jobs have you held with this company? 



1. . FYom: To: 

2. From: To: 

3. . From: To: 
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Workplace Literacy Programs 
Evaluation Guidelines 

10. What other kinds of Jobs have you held? 



11. What kinds of machines, equipment, tools have you used on the Job? 

1. 4. 

2. 5. 

3. 6. ~ 



in. Training & Education Information: 

12. Have you served in the military? 1. ^Yes 2. No 

13. What kinds of Job training have you had? (Please list below) 

1. 

2. 

3. 

4. 

14. What is the last grade you completed in school? 

bekwaii mi 9th lOth 11th lah" 



GED lyr.coU^e morcthan 

lyr.coDEge 

15. Have you earned any college d^rees? 

1- — ^Ves 2. No 3. _Assoclates 4. ^Bachelors 5. Masters 6. ^Other 



16. ^AHilch of the following are vour reasons for attending this training? (You may mark 
up to three answers.) 

a. To Improve my Job performance. 

^b. To qualify for future Job postings. 

^c. To gain experience with test taking skills. 

d. To further my education. 

^e. To meet personal goals. 

^f. To find out more about this training. 

g. To become more active in company training programs. 

h. Other_ 
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Workplace Literacy Programs 
Evaluation Guidelines 



17. Which way do you BEST like to get Information about something you need to know more 
about? (Please mark only one answer.) 

1. Read about it. 

2. Listen to presentations or talks about it. 

3. Have someone show and tell you about it. 

4. Other (describe) 

18. Did you £li22S£ to take this training? 1. ^Yes 2. No 



19. What do you expect to get from this training? 
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Workplace Literacy Programs 
Evaluation Guidelines 

PARTICIPANT POST-PROGRAM SURVEY 

Name Date 

Course title . 

Course location 

Directions : Please answer each question below. The information you give 
will be used to evaluate and help improve the course materials you have used. 

I. Background information: 

1 . How long have you worked at this company ? 

2. How long have you done this kind of work ? 

3. How long have you worked in your present position? . 

4. Whac is your job title? 

5. If you are in a training program, how long have you been in the 

program? For what job position are you 

training?^ 

6. What is your age? 

7. What is your sex? 

Male Female 

n. Course Information: 

8. What can you do now that you couldn't do before taking this course? 



9. How many classes have you attended so far ? 
• classes. 

10. Has this course helped you meet or work toward any of your personal 
goals? 

Yes No 
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Workplace Literacy Programs 
Evaluation Guidelines 

10a. (If you checked ysa for #10, please answer the next part of the 
question) 

In what way? 



11. Circle one number in each row across to show how you would rate each 
item. 

How would vou rate this program? 

Veiyintenestlngtome 5 4 3 2 1 Bortngtome 



Veiy useful to me 

cnthsjob 5 4 3 2 1 


Totally useless to me 
ontfiejob 


Muchtoodifffcultforme 5 4 3 2 1 


Much too easy for me 


Very usefiil to me outsldB 

cfwak 5 4 3 2 1 


'IbtaDy useless to me 
outside Gfwcric 


Exactly what I oq^ected 5 4 3 2 1 


Not at all\^iiat I expected 


How would vou rate the materials? 




Hard to leam and oonfustng 

firme 5 4 3 2 1 


Easy to leam and simple 
forme 



12. Would you recommend this course to a co-worker or friend? 



Yes No 
Why or why not? 



12. If you could change anything about this program, what would it be? 



Thank you for taking time to help evaluate this course. Your answers will 
be very useful in tTjing to make it better. 
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Today's 
Date 



SUPERVISOR RATING OF 
POST-PROGRAM 
PARTICIPANTS 



# 

Name of employee you are rating: Badge # of employee you are rating 



In your opinion, now that the Skill Builders course has been completed, how would 
you rate its effects on this participant that you supervise? Circle the number 
that shows how you fee^. 



JOB ATTITUDE: 

5 4 3 2 1 

Greatly Somewhat The same Somewhat Much 

improved Improved worse worse 

Please give an example: 



QUANTITY OF WORK: 

(Instructional hours missed not included) 



5 4.3 2 I 

Increased Increased Stayed Decreased Decreased 

above 100% some the same some a lot 



QUALITY OF WORK: 

5 4 3 2 1 

Veiyhigh High Meets Some Many 

accuracy accuracy requirements errors errors 



ATTENDANCE: (Other than instrucUonal hours) 

5 4 3 2 1 

Greatly Somewhat Stayed Somewhat Much 

improved improved the same worse worse 



JOB KNOWLEDGE: 

5 4 3 2 1 

Works Needs less Stayed Needs more Needs 

Independently supervision the same supervision constant 

than before than before super/lslon 



• Has the employee asked about other Job positions or announcements since participating? 

If yes. what? 

• With all other things being equal, on the next status report would you recommend a pay increase 
for this employee after his/her partlcipaUon In Skill Builders courses? 

• With all other things being equal, would you recommend this employee for a Job advancement after 
participating In the Skill Builders program? 
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SUPERVISORS' EVALUATION 
OP PROGRAM EFFECTS 
ON THEIR DEPARTMENTS 



Supervlsor"s Name: 

Today's Date: 

• How many employees in youi department participated in a Skill Builders program? 

• In your opinion, what eflfect did the participation of employees from your department 
have on each of the areas below? Circle the answer in each categoiy that shows 
how you feel: 

PRODUCTION: 

5 4 3 2 1 

Greatty Somewhat Stayed Somewhat Greatly 
increased increased the same decreased decreased 



QUALITY: 

5 4 3 2 1 

Greatly Somewhat Stayed A few more Many more 

improved Improved the same errors errors 



COMPANY FUTURE PLANS: 

Having gone through the program, when more computerized technical equipment 
comes to your department, do you think your employees will be able to handle It 

Better The Same Worse 



• Of the empoyees In your department who participated In the program, do you notice any 
team-buUding as a result (greater cooperation or problem sohrlrig among your employees)? 

5 4 3 2 1 

A lot Some Same as Little None 

before 



• Since your employees participated In the program* do you feel that your Job as a 
Supervisor has become: 

5 4 3 2 1 

Much Somewhat Same as Somewhat Much 

easier easier before more difficult more difficult 

Give an example: 



• If the company plans to continue to have employees participate In Skill Biillders programs In 
the future, what would you recommend to Improve the way the program Is run? 



* Based on the effect that the program has had on the employees from your department who 
participated, would you recommend additional employees to the program? Why or why not? 
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II. Site-Generated Evaluation Forms 



Prepared by Performance Plus Uaming Consultants, Inc. - 



I Questionnaire For Employees that 
have taken the Computer Basics 
Class.., 

Name: 

Team: 

(the next page has an evaluation that does not require you give your name) 
Please answer the following questions... 

1. Since taking the class, are you more comfortable around computers? Explain why 
or why not. 

2. Since taking the class, are you more familiar with the words and terms used in 
referring to computers? Explain why or why not. 

3. Has the class helped you learn to interact with computers in a more effective way? 

If so. How? 

4. Did the class help you understand how computers can be used to make you a better 
worker/team member? Explain. 



5. What can you do now as a result of having been in the class? 



6. What things should be changed to make the class better? 



Please return this questionnaire and the Course Evaluation toToni M. in HR-Training 
' soon as possible. , , ,.. 

ERIC : : C 



Evaluation of Computer Basics Course 



To: 

Please help us follow-up on the effectiveness of this training course. Answer each 
question as best you can. If a question does not apply to you, just leave it blank. 

1. Have you been able to use any of the knowledge or skills you learned in this course? 

1. 2. • 3. 4. 

I've used it a lot I've used it a little Ihaven'thadachancetouseit I won't be able to use it 

Comments: . 

2. Have you taken any other computer classes since taking this course? 

Yes? No? 

If yes, what course(s): 

If you have taken other courses, did this course help you in another course? 
1. 2. 3. 4. 

It helped me a lot It helpedmea little It didn't really help . . It left me confused 

Comments: 



3. Do you plan to take other courses in computers at OCS? 

1. 2. 3. 4. 

I'm enrollingin January I plan to take one soon I plan to take one eventually I may not take one 

Comments: 

Did being in the Computer Basics class encourage you to plan to take more classes'* 
Yes? No? Explain: 

4. May we contact your supervisor to ask them a few questions about how the class 
may have affected your performance on the job? 

Okay? Not Okay? 

Please Return this Survey to Lynn Cox in the Training office as soon as possible, 
JThank you. 
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T.T?>^nFR'.q EVALUATION OF TRAINING EFFECTS 
ON THRTR TEAMS 



Leader's Name: 
Today's Date: 
Course Name: 




Below you will find an evaluation matrix. Now that the first year's 
courses have been completed, how would you rate their effects on the 
participants that you lead? Use key below: 



NAME 


PRODUCT- 
ION 


QUALITY 


FUTURE 
PLANS 


CO-OPERATION AND 
PROBLEM SOLVING 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 




5 4 3 2 1 


5 4 3 2 1 


3 2 1 


5 4 3 2 1 



KEY: 

Production: 

5 = Greatly Increased 4 = Somewhat Increased 
2 = Somewhat Decreased 1 = Greatly Decreased 



3 = Stayed the Same 



Qualiliy: 

5 - Greatly Improved 4 = Somewhat Improved 3= Stayed the Same 

2 = A few more errors 1 = Many more errors 

Future Plans: 

After completing the program, when new technical equipment or 
training comes to your department, do you think your employees 
will be able to handle it 

3 = Better 2 = The Same 1 = Worse 

Co-operation or Problem Solving: 

5 = A Lot 4 = Some 3 = Same amount as before program 
2 = Little 1 = None 

Overall: 

Since your employees participated in the progrs^Tn, do you feel 
your job as a leader has becom.e 

5 = Much Easier 4 « Somewhat Easier 3 = Same £ i Before 
2 = Somewhat More Difficult 1 = Much More Difficult 

Please give an example: 



BEST COPY AVAILABLE 



o :n co Jean Gillespie by December 12. Call Toni (457) or Scott 
ERJCl with questions. ^ ^ ^, 



Course Evaluation 
You do not need to write your name on this form. 

it********* 

How long have you worked at this company? 

How long have you done this type of work? 

What is your job title or position? 



What is your sex? M or F (circle one) . 
What is your age? What is your Race? 



lliiat type of problems can you solve that you couldn't before taking the class? 



Your 


Answers are 


Kept 


Confidential 




★ ★ * 


Only 


write your 


Name 


on this if 


want 


to be con- 


tacted 



dyou think the skills you learned in this class will help you in your job? Why, or why not? How? 
4) you think the course has (or will) help you meet any of your personal goals? Why, or why not? How 



A6iiIdyou recommend the course to a fellow-employee or friend? Why or why not? 



the materials and workbooks helpful? What was good or bad about the materials used in this course? 



'yoo could change the course in any way, what would you suggest we do to make it a better class? 



'trde the answer that best applies... 

The course was too hard 
[be course will help me on the job 
rhe course will help me outside of work 
Fhe course was confusing at times 

made it cusy for me to learn 



Circle one: 
agree not sure disagree 
agree not sure disagree 
agree not sure disagree 
agree not sure disagree 
agree not sure disagree 



fwoaldlikeanother class taught this way agree not sure disagree 
^ ********** 

we the beck of this form if you wish to make further comments or suggestions. 
ywt for your help. You will help us make this a better course. 
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BEST COPY AVAIUBLF 



REGISTRATION FORM 



I. Personal Information 
Name _ ^ 



(Last) (First) 
Current Address: _ . . 



(Number and Street) 



(City) (State) (zip) 
Telephone Number Birthdate: 

1. What is your age group? 





16-18yrs. 19-25yr3. 26-36yre. 36-50yrs. 51-65yrs. 55-yrs. 

2. What is your ethnic group? 

1.2L_White 2. Black 3. Indian 4. Hispanic 5. Other 

3. .What is your gender? 1. Male 2. V Female 

4. Circle: (^Single) Married Head of Household 
II. Employment information: 

Extension No.# Mailbox 



5. How long have you worked for this company? 



less than 1 year 1-2yr9. 3-5yrs. 6-10 yrs. more than 10 years 

6. What is your job title? ,/)]A^k.,.^ -^J-.-rxc^h r 

7. How long have you workea in this job title? ///Ay 1?^^ 

(beginning date) 

III. Training and Education Information: 

8. What is the last grade you complete in school? 



below 8 8 9 10 11 12 GED 



1 yr college more than 1 yr. college 

Have you earned any college degrees? 
!• Yes 2. / No 3. Associates 4. Bachelors 5. Masters 
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9. Which of tile following are your reasons for attending this 
class? (You may mark up to three answers.) 

a. To improve my job performance. 

b. To qualify for future job postings. 

c. To further my education. 

V d. To meet personal goals. 

e. To find out more about this training. 

f. To become more active in company training programs 

g. Other ^ 

10. Which way do you BEST like to get information about something 
you need to know more about? (Please mark only one answer.) 

1 . Read about it. 

2. Listen to presentations or talks about it. 

3. Have someone show and tell you about it. 

4 . Other (Describe) 



11. Did you choose to take this class? 1. x Yes 2. No 

12. What do you expect to get from this class? 




WPL 1/15/91 
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PURPOSE OF CRITIQUE: Continual improvement of training dosses and processes. 

Thanks for your assistance. 



CLASS TITLE .'r^^,.,. 7-.^. /3^><^ .r DATE 

INSTRUCTOR (S) \ . a^^^/^r. 



. •> - r - 



1) Were your overall expectations met for this class? 

i 2 ? 4 5 ^ 

noiatali varylKtlg somawhat reasonaoly well definitety beyona expeaations 

If you did not rate a 5 or 6. what could have been done differently to achieve a 5 or 6 rating? 
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-) Please rate the overall appropriateness and quality of the training 
materials (or manual) you received for this class. 

i 2 I £ ^ ^ 

not at ail vofymta somewhat nasonably appmpnata dafiMety boyona expeaations 

If you did not rate a 5 or 6. what could have been done differently to achieve a 5 or 6 rating 



7 



3) Were you contacted regarding this class in a timely manner? 

I 2 I 4 5 ^ 

norafatf veryMIe somewtiat reasonably weH delritefy beyona expectations 

If you did not rate a 5 or 6. what could have been done differently to achieve a 5 or 6 ratmq 



4) How appropriate was the day & time of this class(es)? 

not at ail verytittle somewhat reasonably MfeH definitely beyond expectations 

Comments: 



5) How would you rate the imponance of this subject to your job? 
i 2 ^ 4 5 

not at an veryirttle somewhat reasonably impt definitely impL extremei\t mpt.' 

Comments: ^^AY^ .UrA.= A^^ ^ ro^.....^ ~ 



SEE BACK PLFASF 



CARPENTER TRAINING CENTER 
Monday-Wednesday BCath Lab 



POST-PROGRAM PARTICIPANT 
Survey Sheet 

Class Information: 

1. What can you do now that you couldn't do befor aktng this class? 



2. How many classes have you attended so fai? 



5. 



Classes 



Has this class helped you meet or work toward any of your personal goals? 

Why or why not? . 



Yes No 
Circle one number in each row across to show how you would rate each Item. 



Howwould vou rate th<s Dro^ram? 
Very Interesting to me 


5 


4 


3 2 


1 


Boring to me 


Veiy useful to me on the Job 


5 


4 


3 2 


1 


Totally useless to me 


Very useful to me 
outside work 


5 


4 


3 2 


1 


Totally useless to me 


Exactly what I expected 


5 


4 


3 2 


1 


Not at all what I 


Hqw would vou rate the ij^^^^y^^]^'^ 
Easy to learn and simple 
forme 


5 


4 


3 2 


1 


Hard to learn and 



Would you recommend this course to a co-worker or friend? 
Why or why not? . 



Yes 



No 



6. If you could change anything about this pit)giam. what would it be? 



^nanic you for taking time to help evaluate this course. Your answers will be very useful in t^ to n^e it 
Skill Builders SC/MT 10/14/91 



Anodizing, Inc. 



Math Classes 
Learner Evaluation 

Rate each item hy ..v.i^.^ „,^be^ ^ 

1. This class has been 
very interesting 5 ^ 

2. This class was 
very hard 5 ^ 

3. On the job this class helped me 

to do more accurate 5 4 
work 



4. The 



instructors were 



interesting 



3 2 

5. ^ understood what I was supposed to leam 
most of the time 5 

6. Sufficient practice exercises were included 
toomany 5 4 , 



7. I received sufficient feedback on my practice exercises 
always 5 4^ 



8. The 



reviews measured my performance on the lessons 
^always 5 a ^ 



very boring 



very easy 



not at all 



boring 



rarely 



too few! 



rarely 



never; 
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Learner Survey 




to(a] useless 
to me on the 
job J 



12. What can you do now that you could not do before 



taking this class? 



14. Would you recommend this ctetoaoworker? Whyorwhyno.? 



15. What did you like best about this class? Leas,? 




;^^^|^A™NTO,OHNPOSmBV AUGUST30. .991. 
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Anodizing, Inc. 
Math SkiUs Class 
SUPERVISOR EVALUATION 



Participant. 



Job Tide 



What effect did the participation in die madi class have 



on your employee? Circle the number diat 



1. 'The tt^ee indicated that the course was weU designed and helpful. ^ 


Very wcU done 5 4^^ 


1 poor 


2. He/she mastered die material he/she was taught. 




definitely 5 4^2 


1 not at all 


3. He/she has greater cooperation and/or problem solving ability since the class. 


^« 5 4 3 - 


1 I see no differ- 
ence 1 



Yes 



1 I 



see no differ- 



ence 



5. How do you diink die employee will be able to handle 
your department? 



new procedures introduced into 



Much better 5 



1 Much 



worse 



6. What was die most positive effect of diis 



course on the employee? 



Leupold & Stevens, Inc. 

Math Classes 
Learner Evaluation 

Rate each item by circling one number in each row. 



1. This class has been 
very interesting 5 4 3 2 1 very boring 



2. 


This class was 






very hard 


5 4 S 2 


1 


very easy 




On the job this class helped me 






to do more accurate 5 4 3 2 
work 


1 


not at all 


4. 


The instractor was 






interesting 


5 4 3 2 


1 


boring 


5. 


I understood what I was supposed to leam 






most of the lime 5 4 3 2 


1 


rarely 


6. 


The materials were directly related to the objective 






always 


5 4 3 2 


1 


rarely 


7. 


Sufficient practice exercises were included 






too many 


5 4 3 2 


1 


too few 


8. 


I received sufficient feedback on my practice exercises 






always 


5 4 3 2 


1 


rarely 




The tests measured my performance on tlic objectives 






always 
V 


5 4 3 2 


1 


never 
J 
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10. 


I received sufficient feedback on my test results. 






always 


5 4 


3 2 


1 never 




11. 


After being in this class, I would 








like to have more 5 4 


3 2 


1 no moretrain- 




^^aining like this 




ing like this ^ 



13. What can you do now that you could not do before taking this class? 



14. Has this course helped you meet or work toward any of your personal goals? If so, 
how? 



15. WouIq you recommend this course to a co-worker? Why or why not? 



16. What did you like best about this course? Least? 



PLEASE RETURN TfflS EVALUATION TO ANTHL\ SWANSON BY JUNE 20. 1991. 
THANK YOU FOR YOUR TNPTITt 



. • J'' 



1 ^ 
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Leupold & Stevens, Inc. 
Math SkiUs Class 



SUPERVISOR EVALUATION 

Participant Job Title 

What effect did the participation in the math class have on your employee? Circle the number that 
applies for each iteoL 



f 

1. The trainee indicated that the course was well designed and helpful. 




Very well done 5 4 3 2 


1 


poor 




2. He/she mastered the material he/she was taught 








definitely 5 4 3 2 


1 


not at all 




3. He/she has greater cooperation and/or problem solving ability since the class. 




Yes 5 4 3 2 


1 


I see no differ- 
ence 




4. The trainee applies the skills learned in class on the job. 








Yes 5 4 3 2 


1 


I see no differ- 
ence 




5. How do you think the employee will be able to handle new procedures introduced into 
your department? 




Much better 5 4 3 2 


1 


Much worse 


) 



6. What was the most positive effect of this course on the employee? 



THANK YOU FOR YOUR TNPTTTt 

PLEASE RETURN THIS EVALUATION TO ANTHIA SWANSON BY JUNE 20.1991. 
SkiU BuUdere MT rev. 6/13/91 



To: Date: Ngvernberi 28^. 1990 

From: QlAnne Buryeli and Subject: iQgllsh Class 

The 8-week English in the Workplace course is nearly over. 
It should be recognized that language improvement in a short 
period of time is more difficult to observe than manual skill 
development; however,, your input would be greatly 
appreciated. There has been an emphasis in the class on 
improving pronunciation, speaking up and making suggestions. 

We would like to know if 

is using what s/he has learned. Please rate this employee on 
the scale from 1 to 4, with 1 representing minor improvement 
and 4 representing major improvement. Again^, we value your 
input as part of our evaluation. 

IMPROVEMENT 
Q11Q9C [D§l9!l 

1. Increase in making suggestions 12 3 4 

2. Increase in interaction with others 12 3 4 

3. Increase in speaking up 12 3 4 

4. Increase in sense of confidence 12 3 4 



Please add any additional comments. Your feedback is 
important. 



Remember to keep in mind that these employees value your 
encouragement. They are making the extra effort, after work, 
to learn more English. They greatly appreciate your interest 
and support ! 

Please return this to Barbara in HR no later than Monday, 
December 10. Thank ^^ou. 



Lib a^'^^>^^^^^'^ 



EVP PARTICIPANT EVALUATION 

CONTENT* Liked / OK / Did Not Like 

Work related theme in general 

Personal work related issues 

APPROACH 

Large group discussion 

Small group problem solving 

Pronunciation drill in large group < 

Mechanics 

Length of term - 8 weeks 

Length of class period --/-'/ihours per day 

Number of days per week - 2 days 

Time of class - ft'Wer work 



Location 



Level of Improvement 

SKILL DEVELOPMENT Great / Some / None 

Conversation 

Talk with 

Talk with co-workers 

Speaking up in group meetings 

Conversations with friends 

Listening 

Instructions from 

Corrections from or co-workers 

Reading 

Work related materials 



Non--work related materials - letters, 
newspapers, memos, signs, etc. 

Texts for language practice 

Writing 

Work related memos or forms 

Filling out forms other than for work 

Personal writing letters, lists, notes 

Pronunciation 

« MI 
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NEEDS 

TEACHER STYLE GOOD / OK / IMPRQVEKENT 

Consistent ^^,,3 

Organized ^ 

Listened to needs of class ^^^^ 

Provided corrections , 

Flexible . ^ 

Helpful 

Provided enough variety of materials _ 

so tnat class was not boring — — — ^ 

.Open to suggestions 

Changes in teacher's style I would like to see: 



Changes in class content I would like to see: 



Changes in class mechanics I would like to see: 




Changes in skill" development I would like to see: 





* I am interested in continuing with another EVP terra. Yes / No 
r am now interested in studying ESL at PCC or other 
•educational inf^tituti on 



